-- Logs begin at Sun 2022-09-11 10:07:48 UTC, end at Sun 2022-09-11 11:12:31 UTC. -- Sep 11 10:38:11.069642 dv-cinder-856460-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 10:38:11.078830 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 10:38:11 2022] *** Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: nodename: dv-cinder-856460-3-iscsi Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: machine: x86_64 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: clock source: unix Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: pcre jit disabled Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: detected number of CPU cores: 4 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: current working directory: / Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: detected binary path: /usr/bin/uwsgi-core Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: your processes number limit is 47680 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: your memory page size is 4096 bytes Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: detected max file descriptor number: 2048 Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: lock engine: pthread robust mutexes Sep 11 10:38:11.081039 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: thunder lock: enabled Sep 11 10:38:11.081892 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 10:38:11.081892 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 10:38:11.120281 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: Python main interpreter initialized at 0x55d227b339c0 Sep 11 10:38:11.120281 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: python threads support enabled Sep 11 10:38:11.120281 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: your server socket listen backlog is limited to 100 connections Sep 11 10:38:11.120281 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: your mercy for graceful operations on workers is 90 seconds Sep 11 10:38:11.120620 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 10:38:11.120703 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: *** Operational MODE: preforking *** Sep 11 10:38:11.120938 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: *** uWSGI is running in multiple interpreter mode *** Sep 11 10:38:11.120938 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: spawned uWSGI master process (pid: 122535) Sep 11 10:38:11.121127 dv-cinder-856460-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 10:38:11.121680 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: spawned uWSGI worker 1 (pid: 122536, cores: 1) Sep 11 10:38:11.127949 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: spawned uWSGI worker 2 (pid: 122537, cores: 1) Sep 11 10:38:11.127949 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 10:38:11.782060 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 10:38:11.786585 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 10:38:12.900030 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:38:12.900030 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: from cryptography.utils import int_from_bytes Sep 11 10:38:12.900657 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:38:12.900657 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: from cryptography.utils import int_from_bytes Sep 11 10:38:12.901043 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:38:12.901043 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: from cryptography.utils import int_from_bytes Sep 11 10:38:12.901161 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:38:12.901161 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: from cryptography.utils import int_from_bytes Sep 11 10:38:15.406346 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:38:15.406979 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:38:15.407088 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:38:15.407216 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:38:15.407677 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:38:15.407772 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:38:15.407856 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:38:15.408012 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:38:15.408103 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.408380 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:38:15.408483 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.408639 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:38:15.408725 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409000 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409087 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409331 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409418 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409642 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409727 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.409961 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410058 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410276 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410360 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410596 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410686 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410852 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.410954 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411167 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411270 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411514 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856460-3-iscsi {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411617 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411812 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.411899 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412128 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412260 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412434 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412519 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856460-3-iscsi {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412748 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.412836 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413048 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413142 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413357 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413450 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413657 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413748 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.413968 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.414147 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.414290 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.414589 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.414704 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.414893 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415090 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415222 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415408 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415554 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415750 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.415859 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416060 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416167 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416412 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416542 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416712 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.416798 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417022 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417124 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417341 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417430 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417648 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417746 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856460-3-iscsi {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.417972 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418064 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418282 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418373 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418651 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418736 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856460-3-iscsi {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.418977 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419109 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419292 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419389 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419632 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419721 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.419982 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420076 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420305 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420435 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420612 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420698 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.420936 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.421028 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.421261 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.421354 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.421569 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.422215 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.422410 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.422506 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.422712 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.422844 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423021 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423110 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423325 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423449 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423668 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423757 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.423971 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424056 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424272 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424359 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424520 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424617 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424827 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.424913 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425147 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425235 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425435 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425526 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425744 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.425839 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426006 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426093 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426250 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426377 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426565 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426700 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426884 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.426972 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427185 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427281 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427528 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427620 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427850 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.427949 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428162 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428258 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428464 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428561 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428766 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.428861 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429071 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429167 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429375 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429461 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429682 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429767 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.429987 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430082 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430293 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430380 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430595 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430693 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.430911 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431051 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431231 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431325 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431564 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431655 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431870 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.431968 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432207 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432294 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432506 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432590 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432816 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.432901 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433132 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433217 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433450 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433536 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433757 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.433853 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434058 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434149 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434362 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434448 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434680 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434765 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.434987 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435072 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435296 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435381 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435563 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435651 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435862 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.435974 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436165 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436266 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436484 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436570 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436789 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.436881 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.437092 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.437186 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438025 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438140 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438324 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438412 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438631 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438734 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.438936 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439021 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439234 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439319 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439563 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439734 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439868 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.439955 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440171 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440264 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440470 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440602 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440773 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.440859 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441076 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441159 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441373 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441458 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441679 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441763 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.441984 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442069 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442288 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442373 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442591 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442686 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442892 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.442977 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443193 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443280 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443518 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443618 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443830 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.443918 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444132 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444218 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444450 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444533 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444752 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.444835 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445055 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445143 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445372 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445457 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445675 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445758 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.445976 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446068 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446292 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446377 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446589 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446683 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446893 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.446984 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447203 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447294 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447525 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447613 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447828 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.447915 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448126 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448223 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448426 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448523 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448724 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.448811 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449024 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449115 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449322 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449414 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449620 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449713 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.449914 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450000 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450215 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450309 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450518 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450613 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450816 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.450904 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451125 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451260 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451438 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451543 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451763 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.451847 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.452070 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.452158 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.452375 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.452468 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.452692 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:38:15.452785 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453126 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453219 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453462 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453548 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453795 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.453888 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454112 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454199 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454423 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454509 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454736 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.454836 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455060 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455146 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455370 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455470 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455702 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.455801 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456011 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456098 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456329 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456422 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456649 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456744 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.456982 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457078 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457301 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457386 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457613 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457707 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.457931 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458029 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458240 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458333 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458554 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458651 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458875 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.458971 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459188 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459274 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459516 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459618 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.459945 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460262 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460488 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460577 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460812 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.460898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461138 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461232 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461448 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461545 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461757 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.461844 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462067 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462152 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462391 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462477 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462705 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.462840 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463016 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463103 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463331 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463418 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463666 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463764 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.463989 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464074 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464301 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464387 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464609 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464695 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.464919 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465017 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465230 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465317 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465536 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465623 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465848 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.465940 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466161 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466248 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466472 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466558 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466785 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.466922 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467098 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467185 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467413 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467532 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467749 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.467845 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468060 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468146 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468369 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468462 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468727 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.468822 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469103 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469189 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469408 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469495 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.469814 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470020 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470113 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470325 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470417 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470636 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470723 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.470943 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471030 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471274 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471360 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471606 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471799 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.471918 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.472228 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.472322 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.472535 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.472688 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.472838 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.473149 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.473234 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.473458 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.473586 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.473759 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474021 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474118 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474375 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474471 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474678 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.474786 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475001 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475177 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475305 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475736 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.475947 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476058 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476257 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476550 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476648 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476864 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.476991 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.477173 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.477407 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.477493 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.477794 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.477888 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.478104 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.478197 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.478438 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.478777 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.479024 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.479222 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.479315 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.479679 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.479770 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480009 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480113 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480322 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480579 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480673 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.480925 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481064 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481229 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481455 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481583 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481821 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.481906 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482126 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482221 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482426 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482512 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482726 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.482812 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483027 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483114 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483328 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483444 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483791 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.483971 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.484621 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.484781 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.484939 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485079 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485253 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485491 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485578 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485803 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.485891 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486147 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486241 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486452 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486545 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486755 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.486839 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487063 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487159 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487368 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487474 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487701 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.487788 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488008 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488109 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488332 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488420 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488643 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488729 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.488948 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489036 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489255 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489343 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489561 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489647 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489879 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.489965 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490189 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490277 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490508 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490595 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490824 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.490911 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491148 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491235 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491484 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491575 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491804 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.491892 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492107 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492193 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492421 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492517 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492733 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.492820 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493047 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493141 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493361 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493466 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493682 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493769 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.493994 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494079 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494306 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494403 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494615 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494703 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.494925 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495019 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495236 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495337 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495670 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495877 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.495962 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496187 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496281 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496505 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496600 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496814 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.496901 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497137 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497224 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497446 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497534 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497766 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.497855 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498067 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498156 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498378 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498464 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498693 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.498780 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499007 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499095 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499315 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499400 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499653 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.499743 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.500551 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.500652 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.500877 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.500964 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501273 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501357 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501587 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501688 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501896 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.501982 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502204 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502299 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502515 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502606 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502828 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.502914 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503139 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503235 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503482 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503575 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503780 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.503868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504095 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504195 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504405 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504500 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504709 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.504796 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505010 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505108 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505322 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505410 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505628 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505720 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.505938 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506025 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506250 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506337 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506566 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506706 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506869 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.506955 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507174 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507260 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507501 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507588 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507820 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.507907 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508122 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508208 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508427 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508511 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508729 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.508822 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509041 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509132 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509364 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509459 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509667 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509752 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.509980 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510103 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510298 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510394 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510688 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510909 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.510994 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511217 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511347 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511546 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511634 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511853 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.511938 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512162 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512263 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512553 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512777 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.512863 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513087 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513174 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513395 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513482 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513705 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.513793 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514025 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514120 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514334 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514423 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514644 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514730 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.514953 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515048 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515257 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515351 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515611 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515702 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.515927 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516022 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516266 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516494 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516581 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516827 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.516922 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517143 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517230 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517463 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517550 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517797 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.517890 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518111 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518211 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518427 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518514 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518740 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.518908 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519048 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519142 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519349 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519504 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519682 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519783 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.519987 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520247 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520334 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520587 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520676 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520892 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.520979 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521198 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521287 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521503 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521590 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521811 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.521915 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522114 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522201 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522416 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522510 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522718 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.522819 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523021 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523107 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523331 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523482 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523657 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523791 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.523968 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524063 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524271 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524366 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524594 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524682 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524902 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.524990 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525207 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525294 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525509 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525597 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525813 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.525899 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526134 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526226 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526440 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526528 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526747 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.526869 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527065 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527160 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527373 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527477 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527724 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.527810 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528026 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528122 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528351 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528446 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528657 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528744 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.528961 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529057 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529263 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529351 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529569 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529661 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529874 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.529968 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530175 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530299 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530491 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530577 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530800 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.530896 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531132 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531226 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531480 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531606 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531766 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.531854 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532073 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532169 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532374 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532468 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532686 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532775 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.532993 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533087 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533295 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533382 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533595 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533683 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533899 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.533983 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534204 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534299 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534505 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534592 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534812 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.534899 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535114 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535213 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535417 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535573 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535742 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.535828 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536045 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536148 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536345 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536440 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536651 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536739 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.536956 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537049 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537255 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537348 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537565 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537653 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537875 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.537996 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538175 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538269 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538477 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538564 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538782 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.538868 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539082 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539174 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539385 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539503 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539713 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.539800 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540019 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540116 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540332 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540419 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540638 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540725 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.540941 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541025 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541243 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541337 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541546 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541633 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541847 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.541945 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542149 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542243 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542447 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542532 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542747 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.542842 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543049 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543143 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543347 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543451 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543762 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.543996 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544097 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544300 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544392 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544599 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544685 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544901 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.544990 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545200 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545288 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545504 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545597 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545814 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.545910 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.546118 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.546206 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.546422 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.546509 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.547279 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.547370 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.547621 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.547777 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.547981 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548066 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548231 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548377 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548542 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548691 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.548845 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549001 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549157 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549312 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549468 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549621 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549778 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.549967 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550078 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550277 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550365 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550637 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550731 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.550945 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551043 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551260 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551355 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551609 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551698 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.551928 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552022 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552243 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552338 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552544 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552643 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552851 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.552936 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553159 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553246 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553568 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553774 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.553861 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554079 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554164 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554384 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554479 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554693 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.554791 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555003 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555090 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555313 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555413 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555647 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555737 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.555952 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556039 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556259 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556355 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556566 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556653 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556867 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.556954 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557190 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557331 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557496 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557579 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557797 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.557883 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558101 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558190 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558403 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558491 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558711 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.558797 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559012 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559107 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559324 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559416 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559662 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559761 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.559970 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560058 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560327 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560428 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560594 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560689 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.560993 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561227 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561313 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561537 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561631 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561838 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.561967 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.562147 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.562311 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563035 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563142 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563317 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563405 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563651 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.563740 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564034 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564136 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564335 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564429 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564644 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564733 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.564966 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565054 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565269 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565357 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565655 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565870 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.565965 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566184 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566269 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566483 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566569 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566801 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.566897 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567201 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567293 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567531 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567623 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567836 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.567932 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568140 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568247 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568444 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568544 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568754 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.568841 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569078 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569171 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569383 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569478 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569686 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569779 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.569989 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570075 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570312 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570407 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570615 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570737 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.570936 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571034 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571293 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571379 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571630 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571732 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.571943 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572075 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572249 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572374 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572570 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572691 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572893 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.572988 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.573205 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.573317 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.573526 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.573645 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.573936 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574023 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574259 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574352 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574570 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574659 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574881 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.574966 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575202 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575288 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575527 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575630 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575832 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.575920 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576141 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576236 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576445 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576534 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576746 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.576835 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577068 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577164 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577370 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577496 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577681 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.577768 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578021 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578135 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578320 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578439 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578625 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578741 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.578923 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579046 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579244 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579375 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579710 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.579890 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580016 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580201 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580331 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580521 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580640 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580845 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.580934 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581149 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581244 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581472 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581561 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581779 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.581876 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582082 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582170 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582382 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582470 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582685 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.582775 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583025 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583113 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583330 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583444 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583667 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583754 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.583991 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584073 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584308 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584404 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584615 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584709 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.584941 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585034 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585256 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585387 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585573 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585660 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.585969 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586187 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586280 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586493 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586580 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586795 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.586881 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587096 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587191 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587403 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587530 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587728 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.587824 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588030 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588119 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588331 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588431 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588639 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588733 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.588938 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589027 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589236 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589337 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589536 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589625 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589858 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.589948 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590160 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590248 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590479 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590579 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590791 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.590879 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591092 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591179 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591393 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591563 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591721 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.591812 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592025 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592118 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592331 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592495 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592637 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592725 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.592940 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593028 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593243 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593339 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593572 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593667 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593896 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.593982 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.594200 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.594391 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.594522 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.594712 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.594831 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595033 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595129 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595352 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595475 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595695 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.595785 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596008 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596106 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596326 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596414 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596645 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596734 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.596964 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597060 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597296 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597480 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597621 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597813 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.597952 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598244 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598443 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598565 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598759 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.598884 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599077 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599205 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599393 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599541 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599731 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.599855 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600045 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600176 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600357 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600495 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600671 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.600814 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601005 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601328 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601415 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601654 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601750 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.601968 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602055 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602285 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602373 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602599 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602694 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.602915 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.603008 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.603228 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.603315 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.603819 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.603932 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604135 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604223 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604450 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604544 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604763 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.604851 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605078 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605166 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605392 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605479 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605705 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.605793 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606015 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606102 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606327 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606428 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606641 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606729 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.606950 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607038 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607259 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607355 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607597 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607687 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.607912 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608011 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608330 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608552 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608638 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608871 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.608959 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.609700 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.609798 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.610016 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.610171 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.610492 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.610578 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.610823 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611013 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611143 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611330 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611494 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611693 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.611798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612022 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612111 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612348 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612435 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612666 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612764 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.612982 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613070 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613308 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613396 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613616 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613705 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.613921 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614009 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614232 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614326 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614540 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614752 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.614848 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615071 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615165 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615408 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615515 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615762 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.615862 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616080 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616168 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616386 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616475 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616707 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.616918 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617036 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617266 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617362 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617583 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617670 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.617910 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618036 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618231 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618326 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618536 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618623 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618842 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.618928 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619158 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619245 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619487 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619578 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619793 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.619879 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620106 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620193 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620411 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620641 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620728 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.620989 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621085 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621301 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621389 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621614 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621701 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.621916 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622012 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622225 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622313 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622528 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622615 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622852 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.622940 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623155 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623252 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623480 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623786 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.623874 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624095 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624183 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624400 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624530 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624701 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.624878 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625155 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625282 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625463 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625601 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625776 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.625909 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626082 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626225 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626390 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626533 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626694 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.626863 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627006 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627172 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627355 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627490 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627690 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627780 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.627995 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628122 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628319 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628416 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628625 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628713 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.628928 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629015 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629241 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629342 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629549 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629643 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.629937 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630162 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630251 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630466 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630560 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630779 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.630873 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631108 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631196 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631446 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631661 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631751 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.631997 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632095 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632318 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632405 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632649 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632738 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.632960 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633060 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633273 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633359 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633577 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633671 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.633982 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634197 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634290 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634507 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634630 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634819 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.634908 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.635127 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.635373 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.635480 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.635740 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.635840 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636047 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636143 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636356 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636444 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636664 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636765 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.636972 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637061 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637281 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637368 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637588 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637677 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637896 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.637984 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638201 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638290 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638509 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638598 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638818 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.638911 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639132 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639220 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639458 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639551 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639776 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.639866 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.640088 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.640190 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.640925 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641027 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641240 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641327 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641553 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641797 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.641885 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642116 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642203 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642430 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642517 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642745 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.642833 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.643057 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.643145 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.643366 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.643504 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.643736 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644046 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644134 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644364 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644459 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644683 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.644770 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645004 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645090 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645399 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645627 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.645939 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646026 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646249 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646344 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646658 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646879 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.646967 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.647204 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.647297 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.647537 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.647629 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.647889 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648198 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648295 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648508 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648598 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648813 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.648901 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649116 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649212 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649423 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649512 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649739 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.649834 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650048 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650149 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650350 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650445 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650654 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650748 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.650961 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651057 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651263 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651358 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651586 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651676 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651888 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.651989 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652194 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652288 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652499 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652587 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652797 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.652892 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653097 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653186 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653396 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653485 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653695 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653785 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.653995 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654082 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654294 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654381 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654598 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654686 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654899 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.654986 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655199 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655293 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655520 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655625 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655833 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.655923 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.656679 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.656782 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657086 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657212 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657427 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657514 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657745 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.657842 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658050 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658143 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658358 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658481 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658663 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658763 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.658969 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659057 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659280 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659367 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659614 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.659920 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660008 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660226 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660313 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660531 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660620 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660835 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.660923 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661147 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661241 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661461 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661551 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661771 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.661859 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662088 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662177 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662396 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662493 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662720 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.662806 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663032 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663128 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663339 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663461 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663688 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.663777 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664009 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664104 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664319 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664405 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664638 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664733 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.664951 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665047 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665266 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665354 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665580 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665667 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665892 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.665991 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666200 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666293 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666509 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666596 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666818 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.666905 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667132 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667220 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667464 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667568 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667774 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.667865 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668091 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668179 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668405 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668493 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668727 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.668814 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669043 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669137 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669349 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669445 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669865 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.669955 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670024 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670175 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670281 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670531 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670621 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670846 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.670933 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671189 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671277 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671523 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671686 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671874 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.671976 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.672194 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.672295 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.672588 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.672683 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.672831 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:38:15.672926 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.673236 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.673549 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.673877 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.674206 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.674555 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.674872 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.675217 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.675572 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.675890 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.676206 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.676512 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:38:15.676760 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:38:15.827817 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO dbcounter [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Registered counter for database nova_api Sep 11 10:38:15.837585 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO dbcounter [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Registered counter for database nova_api Sep 11 10:38:15.848387 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.855100 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:15.858197 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.865210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writer thread running {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:15.912121 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.context [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d589948f-9ff2-4577-8172-465a5e52b5f2(cell1) {{(pid=122536) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 10:38:15.916014 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:38:15.916484 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:38:15.918029 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:38:15.918751 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:38:15.919196 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:38:15.921190 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:38:15.921452 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.context [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d589948f-9ff2-4577-8172-465a5e52b5f2(cell1) {{(pid=122537) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 10:38:15.923972 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO dbcounter [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Registered counter for database nova_cell0 Sep 11 10:38:15.926261 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:38:15.926694 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:38:15.927983 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO dbcounter [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Registered counter for database nova_cell1 Sep 11 10:38:15.928291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:38:15.929019 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:38:15.929476 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:38:15.931483 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_concurrency.lockutils [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:38:15.933494 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO dbcounter [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Registered counter for database nova_cell0 Sep 11 10:38:15.935416 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.936757 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.937961 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO dbcounter [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Registered counter for database nova_cell1 Sep 11 10:38:15.944264 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:15.945338 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.948814 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:15.951249 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writer thread running {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:16.083244 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:16.092502 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writer thread running {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:16.093088 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO dbcounter [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Registered counter for database nova_cell0 Sep 11 10:38:16.102432 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:16.102601 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO dbcounter [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Registered counter for database nova_cell0 Sep 11 10:38:16.107612 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:16.111916 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:38:16.116790 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writer thread running {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:38:16.448772 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:38:16.454183 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: WARNING keystonemiddleware.auth_token [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:38:16.456039 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:38:16.462448 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: WARNING keystonemiddleware.auth_token [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:38:16.801366 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:38:16.807304 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:38:16.809711 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: WARNING keystonemiddleware.auth_token [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:38:16.813637 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d227b339c0 pid: 122536 (default app) Sep 11 10:38:16.815846 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:38:16.816247 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: WARNING keystonemiddleware.auth_token [None req-ab7dc939-1e49-49b0-8401-082899d87a97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:38:16.817023 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001866 Sep 11 10:38:16.817444 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Sun Sep 11 10:38:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:38:16.821532 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d227b339c0 pid: 122537 (default app) Sep 11 10:39:38.916965 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:38.918731 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Sep 11 10:39:38.919966 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:38.936937 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_api:SELECT=3 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:38.938194 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_cell0:SELECT=3 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:38.938959 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_cell1:SELECT=3 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:38.939665 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:39.861011 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-38fb13e6-f07f-445f-9863-8479b0fbb0c7 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:39.893963 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-38fb13e6-f07f-445f-9863-8479b0fbb0c7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.967323 Sep 11 10:39:39.895459 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Sun Sep 11 10:39:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:39:42.595250 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:42.596300 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eed32723-7ef5-4591-a168-750ae55a3975 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 11 10:39:42.599726 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:43.098056 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-ca0ffffe-b001-4487-a540-62c5a3454a08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:43.148085 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-ca0ffffe-b001-4487-a540-62c5a3454a08 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.544986 Sep 11 10:39:43.148880 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:39:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:39:43.162849 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:43.163685 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:43.165613 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:43.166384 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:43.381628 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8bd170da-bf39-49e2-abbc-860f5f1fa33d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:43.456479 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8bd170da-bf39-49e2-abbc-860f5f1fa33d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298621 Sep 11 10:39:43.457154 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Sun Sep 11 10:39:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:39:46.107581 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-ca0ffffe-b001-4487-a540-62c5a3454a08 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:46.108800 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-ca0ffffe-b001-4487-a540-62c5a3454a08 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002295 Sep 11 10:39:46.109457 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:46.796475 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-255d09e9-1aee-4e0e-9f6d-c53eb2871941 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "name": "ds512M", "vcpus": 1}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:46.840012 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-255d09e9-1aee-4e0e-9f6d-c53eb2871941 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724346 Sep 11 10:39:46.840610 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:39:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:39:46.853887 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-9e1e9f4a-a8d6-4505-a9ce-7e898186d62e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:46.902741 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-9e1e9f4a-a8d6-4505-a9ce-7e898186d62e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053156 Sep 11 10:39:46.903903 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Sun Sep 11 10:39:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:39:49.519963 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-255d09e9-1aee-4e0e-9f6d-c53eb2871941 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:49.520990 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-255d09e9-1aee-4e0e-9f6d-c53eb2871941 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 11 10:39:49.521412 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:49.938807 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-a77d2466-5b1e-4bfd-960f-97b397d9d0a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:49.959175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-a77d2466-5b1e-4bfd-960f-97b397d9d0a6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430822 Sep 11 10:39:49.959753 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:39:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:39:49.972163 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b448f39-9556-47b7-b846-b7276f57566f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:50.007300 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b448f39-9556-47b7-b846-b7276f57566f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038615 Sep 11 10:39:50.011593 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Sun Sep 11 10:39:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:39:52.665894 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-a77d2466-5b1e-4bfd-960f-97b397d9d0a6 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:52.667152 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-a77d2466-5b1e-4bfd-960f-97b397d9d0a6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Sep 11 10:39:52.667893 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:53.081071 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05a9c9fa-9644-44b3-b380-085932fb9a66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:53.100970 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05a9c9fa-9644-44b3-b380-085932fb9a66 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426795 Sep 11 10:39:53.102915 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:39:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:39:53.115497 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-6358d3cf-7c48-4af8-869d-e2081c609926 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:53.143901 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-6358d3cf-7c48-4af8-869d-e2081c609926 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031929 Sep 11 10:39:53.144488 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Sun Sep 11 10:39:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:39:55.800809 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05a9c9fa-9644-44b3-b380-085932fb9a66 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:55.802031 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05a9c9fa-9644-44b3-b380-085932fb9a66 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Sep 11 10:39:55.802262 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:39:56.254007 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:56.273559 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464956 Sep 11 10:39:56.274434 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:39:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:39:56.288906 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16be918d-5419-4ef9-bee4-56b135120afd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:39:56.314386 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16be918d-5419-4ef9-bee4-56b135120afd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029125 Sep 11 10:39:56.314968 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Sun Sep 11 10:39:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:39:59.484695 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:59.485719 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 11 10:39:59.486129 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:39:59.933513 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9af2804d-1217-4634-998f-2a5fd4e9694d admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:39:59.959781 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9af2804d-1217-4634-998f-2a5fd4e9694d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467485 Sep 11 10:39:59.960325 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Sun Sep 11 10:39:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:02.781945 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:02.782969 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-e4964dfe-9af2-48e8-a11e-ccb8577ce1a9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 11 10:40:02.783370 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:03.188574 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bc73f1b-fd65-4c28-9635-9e52277c9ded admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:03.210322 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bc73f1b-fd65-4c28-9635-9e52277c9ded admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420914 Sep 11 10:40:03.210864 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:40:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:03.223286 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-7b0733a2-6256-4e86-aa21-1532c2c771fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:03.251460 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-7b0733a2-6256-4e86-aa21-1532c2c771fe admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031794 Sep 11 10:40:03.252036 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Sun Sep 11 10:40:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:40:05.901062 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bc73f1b-fd65-4c28-9635-9e52277c9ded admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:05.902059 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bc73f1b-fd65-4c28-9635-9e52277c9ded admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 11 10:40:05.902569 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:06.303756 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-7b3f0c1f-4978-4498-9086-f999c725c85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:06.325112 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-7b3f0c1f-4978-4498-9086-f999c725c85b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415209 Sep 11 10:40:06.325671 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:40:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:06.338044 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-874bdfb0-37f8-4eb0-8fc5-9e2ba9cce12b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:06.367834 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-874bdfb0-37f8-4eb0-8fc5-9e2ba9cce12b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033491 Sep 11 10:40:06.368538 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Sun Sep 11 10:40:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:40:09.033163 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-7b3f0c1f-4978-4498-9086-f999c725c85b admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:09.034180 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-7b3f0c1f-4978-4498-9086-f999c725c85b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 11 10:40:09.034867 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:09.489957 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0982c7b-5134-40c6-ae5b-b616fafb28ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:09.511169 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0982c7b-5134-40c6-ae5b-b616fafb28ff admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470344 Sep 11 10:40:09.512151 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:40:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:40:09.523840 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-8f5d4c75-e8f8-4b27-82cf-53c5378e78d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:09.536166 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:09.553874 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-8f5d4c75-e8f8-4b27-82cf-53c5378e78d3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033574 Sep 11 10:40:09.554448 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Sun Sep 11 10:40:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:40:12.203630 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0982c7b-5134-40c6-ae5b-b616fafb28ff admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:12.204806 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0982c7b-5134-40c6-ae5b-b616fafb28ff admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Sep 11 10:40:12.205236 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:12.672691 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-6a7a19b2-9c34-4a03-bd5c-0c023cc03826 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "disk": 80}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:12.693483 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-6a7a19b2-9c34-4a03-bd5c-0c023cc03826 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482401 Sep 11 10:40:12.694141 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:40:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:12.707276 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c81fbf77-9450-4627-8380-b763505f88c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:12.732761 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c81fbf77-9450-4627-8380-b763505f88c1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028968 Sep 11 10:40:12.733751 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Sun Sep 11 10:40:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:40:15.381534 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-6a7a19b2-9c34-4a03-bd5c-0c023cc03826 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:15.382488 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-6a7a19b2-9c34-4a03-bd5c-0c023cc03826 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 11 10:40:15.383247 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:15.815765 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:15.823227 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:15.838457 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448637 Sep 11 10:40:15.838995 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Sun Sep 11 10:40:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:15.851609 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-139fe54b-7b2c-4126-957a-8ed20fe26608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:15.877719 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-139fe54b-7b2c-4126-957a-8ed20fe26608 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030252 Sep 11 10:40:15.878577 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Sun Sep 11 10:40:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:40:31.891886 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:31.892819 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 11 10:40:31.893219 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:31.904460 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:32.286028 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-75e558fd-b18b-411c-8314-bbed6625818d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:32.304115 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-75e558fd-b18b-411c-8314-bbed6625818d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405038 Sep 11 10:40:32.304661 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Sun Sep 11 10:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:40:33.607936 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:33.608942 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b92d3a0-6078-41b5-b6c4-6510e95e4bb7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 11 10:40:33.609391 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:34.127272 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-52eab7c0-e08f-464e-b8ab-d8ce217ec587 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:34.132572 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.wsgi [None req-52eab7c0-e08f-464e-b8ab-d8ce217ec587 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-52eab7c0-e08f-464e-b8ab-d8ce217ec587 admin admin] Request method failure captured: Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept: application/json Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept-Encoding: gzip, deflate Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Connection: keep-alive Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Content-Length: 0 Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Host: 10.222.0.15 Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-System-Scope: None Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: User-Agent: python-novaclient Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Auth-Token: gAAAAABjHbshImpmpSj_D5Gh5Z8ntYGC4FFvd6PrAVwHgcqcKO46Hxd6bdvAOXQeFdsk3dIP5egvJFaNtUd8UUq6iU729tw8uNz0RYiQkMpjiuINsJNJ_DXTqLYYisspnH-ibG8MyyAMogJlvtSztUyQetbVqRQ4Gn4BRhL2hIil17zSXfgrGMg Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Id: None Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Name: None Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Identity-Status: Confirmed Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Is-Admin-Project: True Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Id: default Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Name: Default Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Name: admin Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Role: member,reader,admin Sep 11 10:40:34.135798 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Roles: member,reader,admin Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant: admin Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Name: admin Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User: admin Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Id: default Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Name: Default Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Name: admin Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: method: > Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: exception: Flavor 42 could not be found. Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: action_args: {'id': '42'} Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:34.137868 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:34.138852 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.140318 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-52eab7c0-e08f-464e-b8ab-d8ce217ec587 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:34.141592 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-52eab7c0-e08f-464e-b8ab-d8ce217ec587 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391942 Sep 11 10:40:34.141592 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Sun Sep 11 10:40:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:34.147126 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f6b9e6d9-2370-42ce-8530-77d69aefdbba admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:34.170590 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f6b9e6d9-2370-42ce-8530-77d69aefdbba admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026876 Sep 11 10:40:34.171060 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:34.181647 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-23a369d0-a76c-44f4-99d4-4f7ff0695c76 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:34.203845 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-23a369d0-a76c-44f4-99d4-4f7ff0695c76 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026579 Sep 11 10:40:34.204373 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:34.213674 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4bb604c-4b4a-436d-a37c-c1041f0b7f04 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:34.218874 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f4bb604c-4b4a-436d-a37c-c1041f0b7f04 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4bb604c-4b4a-436d-a37c-c1041f0b7f04 admin admin] Request method failure captured: Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept: application/json Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept-Encoding: gzip, deflate Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Connection: keep-alive Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Content-Length: 0 Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Host: 10.222.0.15 Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-System-Scope: None Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: User-Agent: python-novaclient Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjHbshImpmpSj_D5Gh5Z8ntYGC4FFvd6PrAVwHgcqcKO46Hxd6bdvAOXQeFdsk3dIP5egvJFaNtUd8UUq6iU729tw8uNz0RYiQkMpjiuINsJNJ_DXTqLYYisspnH-ibG8MyyAMogJlvtSztUyQetbVqRQ4Gn4BRhL2hIil17zSXfgrGMg Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Id: None Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Name: None Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Identity-Status: Confirmed Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Is-Admin-Project: True Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Id: default Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Name: Default Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Name: admin Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Role: member,reader,admin Sep 11 10:40:34.222129 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Roles: member,reader,admin Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant: admin Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Name: admin Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User: admin Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Id: default Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Name: Default Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Name: admin Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: method: > Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: exception: Flavor 42 could not be found. Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: action_args: {'id': '42'} Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:34.223632 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:34.224675 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:34.226066 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4bb604c-4b4a-436d-a37c-c1041f0b7f04 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:34.227291 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4bb604c-4b4a-436d-a37c-c1041f0b7f04 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013546 Sep 11 10:40:34.227291 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Sun Sep 11 10:40:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:35.459356 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-23a369d0-a76c-44f4-99d4-4f7ff0695c76 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:35.461332 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-23a369d0-a76c-44f4-99d4-4f7ff0695c76 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002452 Sep 11 10:40:35.461726 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:35.987999 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5956f937-19c5-4e5c-a520-ef7cbdb81d48 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:35.992979 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5956f937-19c5-4e5c-a520-ef7cbdb81d48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5956f937-19c5-4e5c-a520-ef7cbdb81d48 admin admin] Request method failure captured: Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept: application/json Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept-Encoding: gzip, deflate Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Connection: keep-alive Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Content-Length: 0 Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Host: 10.222.0.15 Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-System-Scope: None Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: User-Agent: python-novaclient Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjHbsj09lcksxOTPa6EuCL263cr3DFDMaHyZSVuzG-hT9WS5VEa1g7m-cyBeYSrb71JbXWQQ-dPV12MWgQJknzdIjQy2wdyjpN5N7Y7qvyT62ytzzVEC6OOGwvBQ-4E_98uGRIXVUkE8RAaI8bPANKvbeC7mso4bjJ7KtGi2EJ0DdIEIY Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Id: None Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Name: None Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Identity-Status: Confirmed Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Is-Admin-Project: True Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Id: default Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Name: Default Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Name: admin Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Role: member,reader,admin Sep 11 10:40:35.994467 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Roles: member,reader,admin Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant: admin Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Name: admin Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User: admin Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Id: default Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Name: Default Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Name: admin Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: method: > Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: exception: Flavor 84 could not be found. Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: action_args: {'id': '84'} Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:35.995882 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:35.996717 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:35.998234 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5956f937-19c5-4e5c-a520-ef7cbdb81d48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:35.999561 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5956f937-19c5-4e5c-a520-ef7cbdb81d48 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394441 Sep 11 10:40:35.999561 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Sun Sep 11 10:40:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:36.006009 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-d35d9dd9-3326-47a4-857d-c4ac898c8bda admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:36.020821 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-d35d9dd9-3326-47a4-857d-c4ac898c8bda admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018425 Sep 11 10:40:36.021361 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:36.031016 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae5a9904-c01d-4528-977d-0c5e27d926ad admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:36.046966 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae5a9904-c01d-4528-977d-0c5e27d926ad admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019969 Sep 11 10:40:36.047502 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:36.056705 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-0daa0584-332d-420e-8b22-b21bdf8d57bd admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:36.061782 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.wsgi [None req-0daa0584-332d-420e-8b22-b21bdf8d57bd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-0daa0584-332d-420e-8b22-b21bdf8d57bd admin admin] Request method failure captured: Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept: application/json Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept-Encoding: gzip, deflate Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Connection: keep-alive Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Content-Length: 0 Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Host: 10.222.0.15 Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-System-Scope: None Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: User-Agent: python-novaclient Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Auth-Token: gAAAAABjHbsj09lcksxOTPa6EuCL263cr3DFDMaHyZSVuzG-hT9WS5VEa1g7m-cyBeYSrb71JbXWQQ-dPV12MWgQJknzdIjQy2wdyjpN5N7Y7qvyT62ytzzVEC6OOGwvBQ-4E_98uGRIXVUkE8RAaI8bPANKvbeC7mso4bjJ7KtGi2EJ0DdIEIY Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Id: None Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Name: None Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Identity-Status: Confirmed Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Is-Admin-Project: True Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Id: default Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Name: Default Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Name: admin Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Role: member,reader,admin Sep 11 10:40:36.063314 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Roles: member,reader,admin Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant: admin Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Name: admin Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User: admin Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Id: default Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Name: Default Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Name: admin Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: method: > Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: exception: Flavor 84 could not be found. Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: action_args: {'id': '84'} Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:36.064900 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:36.065898 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:36.067210 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-0daa0584-332d-420e-8b22-b21bdf8d57bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:36.068481 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-0daa0584-332d-420e-8b22-b21bdf8d57bd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011562 Sep 11 10:40:36.068481 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Sun Sep 11 10:40:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 11 10:40:37.286369 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae5a9904-c01d-4528-977d-0c5e27d926ad admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:37.287375 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae5a9904-c01d-4528-977d-0c5e27d926ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 11 10:40:37.287818 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:37.805395 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-48ff3063-a9eb-412f-9ef0-c812037f6bae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:37.812097 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.wsgi [None req-48ff3063-a9eb-412f-9ef0-c812037f6bae admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-48ff3063-a9eb-412f-9ef0-c812037f6bae admin admin] Request method failure captured: Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept: application/json Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Accept-Encoding: gzip, deflate Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Connection: keep-alive Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Content-Length: 0 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Host: 10.222.0.15 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Openstack-System-Scope: None Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: User-Agent: python-novaclient Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Auth-Token: gAAAAABjHbsl8QHz27ihu13okiPRVvD21cEF1gt5uVnJouW5zd2qDZLz8pcZIbkUl-2f15MeqIoOrnKysAglvpNNDBW4moqqyd9yretSO-pEimAdaVyA9SlTa-c8lo7503sp7CbzxJFqmPtq8OWNFxq9lh5HMHwf_mCaR9fih74KGDYQejStpX4 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Id: None Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Domain-Name: None Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Identity-Status: Confirmed Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Is-Admin-Project: True Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Id: default Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Domain-Name: Default Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Project-Name: admin Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Role: member,reader,admin Sep 11 10:40:37.813603 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Roles: member,reader,admin Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant: admin Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-Tenant-Name: admin Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User: admin Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Id: default Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Domain-Name: Default Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: X-User-Name: admin Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: method: > Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: exception: Flavor 451 could not be found. Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: action_args: {'id': '451'} Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:37.815310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:37.816175 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.817291 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-48ff3063-a9eb-412f-9ef0-c812037f6bae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:37.818322 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-48ff3063-a9eb-412f-9ef0-c812037f6bae admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389251 Sep 11 10:40:37.818322 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:40:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:37.825489 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1cbdcf1-4c9a-4c42-adbe-ce6ed3ee47dc admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:37.840385 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1cbdcf1-4c9a-4c42-adbe-ce6ed3ee47dc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019167 Sep 11 10:40:37.840907 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:40:37.850492 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:37.866602 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019649 Sep 11 10:40:37.867159 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Sun Sep 11 10:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:40:37.877566 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53378fe6-0bbb-4e15-b5ee-be8006191cee admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:37.883182 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-53378fe6-0bbb-4e15-b5ee-be8006191cee admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53378fe6-0bbb-4e15-b5ee-be8006191cee admin admin] Request method failure captured: Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept: application/json Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Accept-Encoding: gzip, deflate Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Connection: keep-alive Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Content-Length: 0 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Host: 10.222.0.15 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-Api-Version: compute 2.92 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Openstack-System-Scope: None Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: User-Agent: python-novaclient Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjHbsl8QHz27ihu13okiPRVvD21cEF1gt5uVnJouW5zd2qDZLz8pcZIbkUl-2f15MeqIoOrnKysAglvpNNDBW4moqqyd9yretSO-pEimAdaVyA9SlTa-c8lo7503sp7CbzxJFqmPtq8OWNFxq9lh5HMHwf_mCaR9fih74KGDYQejStpX4 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Id: None Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Domain-Name: None Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Identity-Status: Confirmed Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Is-Admin-Project: True Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Id: default Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Domain-Name: Default Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Project-Name: admin Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Role: member,reader,admin Sep 11 10:40:37.884425 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Roles: member,reader,admin Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcf7c8cb1c844da09226c671da5a163e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcf7c8cb1c844da09226c671da5a163e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcf7c8cb1c844da09226c671da5a163e"}]}] Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant: admin Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Id: dcf7c8cb1c844da09226c671da5a163e Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-Tenant-Name: admin Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User: admin Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Id: default Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Domain-Name: Default Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Id: 3570ee53f3c442848938999c912a848b Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: X-User-Name: admin Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: method: > Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: exception: Flavor 451 could not be found. Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: action_args: {'id': '451'} Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:40:37.885875 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:37.886743 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Sep 11 10:40:37.888650 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53378fe6-0bbb-4e15-b5ee-be8006191cee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:40:37.890042 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53378fe6-0bbb-4e15-b5ee-be8006191cee admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011923 Sep 11 10:40:37.890042 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:40:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:39.104093 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:39.105412 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Sep 11 10:40:39.105803 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:39.638612 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4edeadca-dca8-4c19-8ba4-3e27b8462e51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:39.658786 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4edeadca-dca8-4c19-8ba4-3e27b8462e51 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.411721 Sep 11 10:40:39.659258 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Sun Sep 11 10:40:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:40:40.881764 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:40.882763 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 11 10:40:40.883176 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:41.402593 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81e480b6-4870-429d-a318-6983f6031cde admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:41.421449 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81e480b6-4870-429d-a318-6983f6031cde admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398416 Sep 11 10:40:41.421985 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Sun Sep 11 10:40:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:40:42.656232 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:42.657245 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 11 10:40:42.657642 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:43.179619 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5b41308-c33c-44df-95af-84a52107dafc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:43.197988 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5b41308-c33c-44df-95af-84a52107dafc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401609 Sep 11 10:40:43.198554 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Sun Sep 11 10:40:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:44.473080 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:44.474106 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 11 10:40:44.474493 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:44.998041 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48656afd-6f56-4329-ab1e-6c0e3b33816f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:40:45.016325 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48656afd-6f56-4329-ab1e-6c0e3b33816f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402291 Sep 11 10:40:45.016862 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Sun Sep 11 10:40:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:40:46.241808 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:46.242840 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 11 10:40:46.243232 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:40:46.758583 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ec37c59-26b7-4d9e-a15b-67250a82c608 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:40:46.780562 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ec37c59-26b7-4d9e-a15b-67250a82c608 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401479 Sep 11 10:40:46.781093 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Sun Sep 11 10:40:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:41:43.566460 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:43.567543 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-441b5942-b6ad-40e8-9d36-a38d6789beae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 11 10:41:43.567946 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Sun Sep 11 10:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:41:43.578933 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:43.961956 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64cc478d-1cf0-48bd-a8d7-c8487fd95289 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:43.982872 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64cc478d-1cf0-48bd-a8d7-c8487fd95289 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408386 Sep 11 10:41:43.983412 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Sun Sep 11 10:41:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:41:44.004513 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_api:SELECT=14 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:44.008477 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-be3694e9-5dad-4d07-b5f9-f1f8ecc7e526 admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:44.016176 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-be3694e9-5dad-4d07-b5f9-f1f8ecc7e526 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013125 Sep 11 10:41:44.016694 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Sun Sep 11 10:41:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:41:44.028236 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41db5530-a30c-4add-ac02-2d3274371f5a admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:44.035489 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41db5530-a30c-4add-ac02-2d3274371f5a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010883 Sep 11 10:41:44.036001 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Sun Sep 11 10:41:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:41:44.047308 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:44.054353 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010782 Sep 11 10:41:44.054866 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Sun Sep 11 10:41:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:41:44.066807 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-586fca0c-11e0-4ce2-aa6a-937e6e52daf3 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:41:44.074860 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-586fca0c-11e0-4ce2-aa6a-937e6e52daf3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011634 Sep 11 10:41:44.075376 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Sun Sep 11 10:41:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:44:37.939949 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:37.940967 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 11 10:44:37.941362 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:44:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:44:38.081648 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:38.242081 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:38.246762 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:38.247237 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:38.247693 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:38.248407 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:38.248850 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:38.249389 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:38.281504 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0bd4be71-a2f9-4fae-b533-bc57b7db5735 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201045 Sep 11 10:44:38.282070 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:44:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:44:39.378496 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:39.379540 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 11 10:44:39.379943 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:44:39.569737 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:39.573200 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:39.573677 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:39.574110 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:39.574825 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:39.575274 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:39.575728 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:39.595314 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03dcc72b-0d18-4147-8073-8d1e76ce8cce admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076458 Sep 11 10:44:39.595878 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:44:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:44:51.084239 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:51.085310 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 11 10:44:51.085704 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:44:51.231061 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:51.231802 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:51.232431 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:51.281444 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:51.284871 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:51.285344 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:51.285769 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:51.286474 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:51.286916 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:51.287330 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:51.312906 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac774be0-0482-4c30-bdf8-714aa744f675 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087134 Sep 11 10:44:51.313462 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:44:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:44:52.393383 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG nova.api.openstack.wsgi [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] Calling method '>' {{(pid=122537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:52.394395 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: INFO nova.api.openstack.requestlog [None req-1c83f1f8-9bfd-4b89-855e-6151aa76e29d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 11 10:44:52.394790 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: [pid: 122537|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Sun Sep 11 10:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:44:52.584708 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:44:52.588156 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:52.588629 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:52.589059 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:52.589807 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:44:52.590253 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:44:52.590687 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:44:52.612588 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6fc1f7a4-fb7a-44c5-8ffa-f426db13efd4 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079808 Sep 11 10:44:52.613130 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Sun Sep 11 10:44:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:45:51.098759 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: Sun Sep 11 10:45:51 2022 - graceful shutdown triggered... Sep 11 10:45:51.098865 dv-cinder-856460-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 10:45:51.099911 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: Gracefully killing worker 2 (pid: 122537)... Sep 11 10:45:51.100289 dv-cinder-856460-3-iscsi devstack@n-api.service[122536]: Gracefully killing worker 1 (pid: 122536)... Sep 11 10:45:51.227801 dv-cinder-856460-3-iscsi devstack@n-api.service[122537]: DEBUG dbcounter [-] [122537] Writing DB stats nova_api:SELECT=4 {{(pid=122537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:45:52.104767 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: worker 1 buried after 1 seconds Sep 11 10:45:52.105323 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: worker 2 buried after 1 seconds Sep 11 10:45:52.105323 dv-cinder-856460-3-iscsi devstack@n-api.service[122535]: goodbye to uWSGI. Sep 11 10:45:52.106603 dv-cinder-856460-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 11 10:45:52.107153 dv-cinder-856460-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 10:45:52.109916 dv-cinder-856460-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 10:45:52.119707 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 10:45:52 2022] *** Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: nodename: dv-cinder-856460-3-iscsi Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: machine: x86_64 Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: clock source: unix Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: pcre jit disabled Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: detected number of CPU cores: 4 Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: current working directory: / Sep 11 10:45:52.121689 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: detected binary path: /usr/bin/uwsgi-core Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: your processes number limit is 47680 Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: your memory page size is 4096 bytes Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: detected max file descriptor number: 2048 Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: lock engine: pthread robust mutexes Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: thunder lock: enabled Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 10:45:52.122332 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 10:45:52.163641 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: Python main interpreter initialized at 0x55dadf4d79c0 Sep 11 10:45:52.163641 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: python threads support enabled Sep 11 10:45:52.163641 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: your server socket listen backlog is limited to 100 connections Sep 11 10:45:52.163641 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: your mercy for graceful operations on workers is 90 seconds Sep 11 10:45:52.164092 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 10:45:52.164180 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: *** Operational MODE: preforking *** Sep 11 10:45:52.164455 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: *** uWSGI is running in multiple interpreter mode *** Sep 11 10:45:52.164455 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: spawned uWSGI master process (pid: 137513) Sep 11 10:45:52.164663 dv-cinder-856460-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 10:45:52.165243 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: spawned uWSGI worker 1 (pid: 137534, cores: 1) Sep 11 10:45:52.165741 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: spawned uWSGI worker 2 (pid: 137535, cores: 1) Sep 11 10:45:52.166027 dv-cinder-856460-3-iscsi devstack@n-api.service[137513]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 10:45:52.834802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 10:45:52.847576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 10:45:53.994279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:45:53.994279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: from cryptography.utils import int_from_bytes Sep 11 10:45:53.994882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:45:53.994882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: from cryptography.utils import int_from_bytes Sep 11 10:45:54.017557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:45:54.017557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: from cryptography.utils import int_from_bytes Sep 11 10:45:54.018149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:45:54.018149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: from cryptography.utils import int_from_bytes Sep 11 10:45:56.390566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:45:56.391211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:45:56.391546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:45:56.391792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:45:56.392054 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:45:56.392450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.392778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.393103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.393426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.393764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.394077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.394452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.394728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.395061 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.395365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.395719 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.396220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856460-3-iscsi {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.396552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.396865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.397183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.397509 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.397817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.398144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.398456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.398968 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400908 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.400986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.401319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.401620 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.401952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.402276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.402686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856460-3-iscsi {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.403003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.403320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.403690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.404119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.404420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.404732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.405053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.405386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.405705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.406044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.406350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.406673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.406994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.407302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.407636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.407950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.408273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.408584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.408897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.409151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.409463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.409791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.410118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.410445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.410700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.411604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.411844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.412190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.412460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.412773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.413084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.413396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.413703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.414018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.414329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.414637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.414961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.415289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.415653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.415966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.416296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.416712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.416964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.417273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.417661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.417951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.418269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.418587 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.418911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.419222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.419556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.419868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.420192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.420533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.420840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.421095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.421400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.421706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.422027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.422335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.422642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.422952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.423257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.423614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.423929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.424240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.424544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.424851 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.425165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.425474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.425782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.426090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.426399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.427489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.427830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.428144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.428461 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.428775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.429086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.429411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.429724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.430033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.430361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.430673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.430982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.431306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.431659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.431973 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.432297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.432600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.432908 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.433228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.433616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.433888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.434168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.434441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.434748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.435075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.435365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.435694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.435998 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.436320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.436655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.436957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.437264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.437573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.437892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.438237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.438573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.438922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.439350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.439590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.439926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.440247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.440563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.440880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.441212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.441529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.441885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.442693 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.443025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.443345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.443855 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.444157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.444478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.444791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.445110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.445433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.445769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.446097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.446411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.446760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.447111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.447479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.447818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.448148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.448466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.448785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.449100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.449499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.449770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.450090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.450414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.450732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.450893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:45:56.451375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:45:56.451576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.451576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.451867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:45:56.452060 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.452221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:45:56.452373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.452517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:45:56.452662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.452814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.452963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.453144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.453292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.453443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.453597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.453768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.454075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.454332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.454507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.454735 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.454983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.455141 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.455329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.455512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.455662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.455816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.455974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.456139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.456292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.456478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.456629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.456817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856460-3-iscsi {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.456982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.456982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.457367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.457523 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.457665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.457870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.458106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.458106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.458396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.458547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.458698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.459045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.459205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.459357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.459733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.459733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.460037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.460210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.460210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.460501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.460651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.460801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.460954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.461098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.461241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.461421 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.461567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.461718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.461877 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.462020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.465139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.465325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.465486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.465646 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.465810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.465956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.466106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.466259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.466405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.466558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856460-3-iscsi {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.466710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.466860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.467004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.467153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.467324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.467590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.467758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.467920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.468092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.468320 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.468480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.468631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.468782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.468935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.469079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.469230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.469396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.469540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.469872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.470024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.470168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.470329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.470490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.470635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.470781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.470923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.471075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.471227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.471372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.471570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.471742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.472073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.472235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.472393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.472546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.472697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.472886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.473041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.473193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.473887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.474052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.474258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.474460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.474627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.474970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.475344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.475510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.475602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.475705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.475797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.475797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.475952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.476892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.476972 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.477052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.477205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.477357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.477506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.477671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.477671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.478092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.478249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.478590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.478807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.478880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.478958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.479100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.479250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.479400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.479582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.479744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.479835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.480184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.480336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.480544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.480702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.480862 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.480985 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.481068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.481552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.481637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.481809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.481903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.482111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.482193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.482415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.482498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.482734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.482817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.483039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.483128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.483345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.483556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.483657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.483747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.483963 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.484067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.484267 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.484360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.484572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.484672 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.484975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.485092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.485203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.485433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.485542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.485629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.485761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.485860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.486066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.486172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.486371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.486471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.486676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.486768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.486980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.487081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.487297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.487390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.487655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.487749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.487962 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.488062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.488269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.488361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.488595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.488704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.488861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.488964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.489801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.489901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.490191 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.490368 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.490673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.490757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.491004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.491094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.491324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.491415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.491668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.491751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.491982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.492080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.492301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.492391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.492605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.492692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.492927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.493020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.493230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.493313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.493537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.493634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.493853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.493945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.494158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.494248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.494462 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.494552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.494765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.494857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.495100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.495209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.495736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.495891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.495891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.496307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.496307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.496625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.496765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.496915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.497066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.497305 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.497448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.497608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.497759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.497906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.498123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.498276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.498426 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.498579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.498856 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.499004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.499154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:45:56.499307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.499505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.499656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.499796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.499948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.500098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.500262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.500561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.500704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.500843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.501865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.502867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503293 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.503894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504181 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504477 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.504981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.505422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.505422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.505841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506514 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.506853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507374 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.507844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.508941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.509862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510376 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.510999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.511091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.511312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.511401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.511947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.512100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.512335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.512536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.512706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.512852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.513889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.514973 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.515126 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.515447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.515603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.515770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516323 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.516787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517311 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.517903 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518484 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.518781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.519878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.520034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.520185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521639 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.521936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522232 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522232 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.522960 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.523898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.524053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.524205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.524884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.525052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.525206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.525541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.525704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.525849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.526995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.527360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.527621 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.527778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.527923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.528850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.529899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.530807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531327 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.531854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.532155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.532836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.533040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.533187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.533340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.533340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.533614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.534340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.534493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.534650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.534805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.534805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.535153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.535417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.535751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.535751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.536988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.537994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.538862 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.539996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540293 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.540742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.541025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.541296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.541457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.541604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.541763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542646 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.542952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.543103 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.543255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.543436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.543593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.543878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.544838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.545030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.545187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.545333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.545477 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.546179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.546344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.546510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.546743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.546901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.547055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.547217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.547693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.547844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.547957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548587 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548905 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.548983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.549918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550525 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550702 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550799 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.550975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.551068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.551068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.551068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.551068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.551068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.552872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.553941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.554979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555268 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.555985 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.556968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557363 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.557992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.558925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.559901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.560822 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.561977 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562586 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.562900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.563935 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.564980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.565866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.566781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.567960 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568264 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.568982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569198 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.569907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570226 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570518 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.570841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571214 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.571824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.572986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.573289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.573505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.573635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.573830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.573939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.574954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575264 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.575956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.576988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.577931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578564 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.578962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.579989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.580974 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581894 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.581995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.582202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.582302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.582503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.582605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.583345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.583509 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.583809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.583897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.584917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.585861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.586946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.587976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.588921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.589941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.590842 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591685 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.591989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592311 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.592922 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593528 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.593964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.594931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.595901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.596817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.597967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.598082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.598271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.598422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.598855 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.598938 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.599296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.599397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.599658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.599758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.599989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.600949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.601979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602195 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.602917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603126 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603462 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.603885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.604922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.605998 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.606469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.606582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.606782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.606879 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.607840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.608997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609714 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.609936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.610960 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.611949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.612872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613170 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.613804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.614526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.614629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.615874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616295 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.616921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617659 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.617973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.618951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.619917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.620887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.621922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622528 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.622853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623059 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.623837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.624996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625304 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625611 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625702 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.625919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.626946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.627896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628235 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628545 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.628852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.629867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.630177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.630374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.630497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.630749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.630848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631561 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.631846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632363 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.632809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.633789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634425 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.634976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.635956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.636997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637305 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.637933 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638741 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.638842 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.639794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640709 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.640917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.641932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.642851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643369 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.643812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644413 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.644924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.645018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.645766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.645922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.646112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.646254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.646433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.646762 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.646853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647178 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.647980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.648950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.649896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650830 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.650921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.651920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.652870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.653813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.654973 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.655934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.656964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.657913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.658869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659549 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.659845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.660956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.661723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.662033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:45:56.662124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.663047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.663397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.663749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.664074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.664411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.664726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.665038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.665354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.665671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.665979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.666305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.666621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.666929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.667253 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.667592 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.668135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.668491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.668808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.669138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.669467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.669786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.670094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.670420 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.670729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.671036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.671352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.671691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.671997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.672302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.672614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.672923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.673229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.673540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.673858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.674502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.674502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.674768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.675055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.675364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.675696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.676000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.676305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.676682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.677270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.677590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.678002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.678318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.678635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.678989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.679305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.679639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.679966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.680275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.680582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.680906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.681218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.681543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.681858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.682169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.682522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.682844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.683412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.683755 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.684077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.684416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.684749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.685061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.685369 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.685678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.686001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.686315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.686627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.686940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.687250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.687583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.687899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.688217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.688527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.688836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.689147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.689457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.689766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.690075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.690385 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.690700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.691041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.691359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.691706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.692025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.692485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.693051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.693373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.693686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.694073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.694318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.694652 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.694968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.695275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.695727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.696042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.696361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.696682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.696997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.697322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.697645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.697956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.698285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.698595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.698928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.699266 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.699620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.699946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.700252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.700559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.700864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.701176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.701493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.701802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.702105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.702409 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.702719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.703022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.703325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.703654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.703957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.704265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.704564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.704866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.705169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.705470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.705771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.706071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.706378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.706680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.706983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.707285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.707685 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.708700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.709153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.709492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.709812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.710139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.710452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.710781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.711093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.711415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.711762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.712080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.712391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.712723 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.713036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.713347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.713659 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.713971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.714281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.714590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.714919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.715243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.715571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.715900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.716218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.716540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.716857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.717169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.717500 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.717811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.718120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.718433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.718750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.719064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.719378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.719731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.720045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.720361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.720677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.721006 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.721334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.721643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.721970 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.722298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.722644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.722959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.723302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.724026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO dbcounter [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Registered counter for database nova_api Sep 11 10:45:56.724325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.724849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.725169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.725480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:45:56.725725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:45:56.744718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_db.sqlalchemy.engines [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.751682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writer thread running {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:56.788860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO dbcounter [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Registered counter for database nova_api Sep 11 10:45:56.807672 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.context [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d589948f-9ff2-4577-8172-465a5e52b5f2(cell1) {{(pid=137534) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 10:45:56.808782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_db.sqlalchemy.engines [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.811710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:45:56.812187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:45:56.813890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:45:56.814630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:45:56.815073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:45:56.815365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writer thread running {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:56.817086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:45:56.819499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO dbcounter [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Registered counter for database nova_cell0 Sep 11 10:45:56.823612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO dbcounter [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Registered counter for database nova_cell1 Sep 11 10:45:56.831318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_db.sqlalchemy.engines [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.832619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_db.sqlalchemy.engines [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.840386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writer thread running {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:56.841814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writer thread running {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:56.878979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.context [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d589948f-9ff2-4577-8172-465a5e52b5f2(cell1) {{(pid=137535) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 10:45:56.884012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:45:56.884485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:45:56.886033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:45:56.886771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:45:56.887216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:45:56.889213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:45:56.891220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO dbcounter [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Registered counter for database nova_cell0 Sep 11 10:45:56.895252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO dbcounter [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Registered counter for database nova_cell1 Sep 11 10:45:56.903400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_db.sqlalchemy.engines [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.905223 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_db.sqlalchemy.engines [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:56.910512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writer thread running {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:56.989035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO dbcounter [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Registered counter for database nova_cell0 Sep 11 10:45:56.996704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_db.sqlalchemy.engines [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:57.001498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writer thread running {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:57.051557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writer thread running {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:57.061684 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO dbcounter [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Registered counter for database nova_cell0 Sep 11 10:45:57.069273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_db.sqlalchemy.engines [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:45:57.073984 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writer thread running {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:45:57.323334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: WARNING keystonemiddleware.auth_token [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:45:57.330628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: WARNING keystonemiddleware.auth_token [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:45:57.409336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: WARNING keystonemiddleware.auth_token [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:45:57.416930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: WARNING keystonemiddleware.auth_token [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:45:57.672341 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: WARNING keystonemiddleware.auth_token [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:45:57.679280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: WARNING keystonemiddleware.auth_token [None req-55c8475c-f8fd-49ed-9a7c-b1eaf8e31358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:45:57.684816 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dadf4d79c0 pid: 137534 (default app) Sep 11 10:45:57.782267 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: WARNING keystonemiddleware.auth_token [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 10:45:57.788940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: WARNING keystonemiddleware.auth_token [None req-91ea5733-ee1c-4042-a789-12d09a4a1ed2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 10:45:57.794204 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dadf4d79c0 pid: 137535 (default app) Sep 11 10:46:33.225786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:33.227159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:33.228071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:33.228980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.314668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.317055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.319884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.323132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.433904 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3d5b27db-49aa-4dee-8ae5-e17a40f9e5f2 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Action: 'create', calling method: .version_select at 0x7f75a0fd24c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-837603704"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:35.710190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0113d6b1-b7d9-4519-b550-4ea8259778ac tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Action: 'create', calling method: .version_select at 0x7f75a0fd3430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1545482169", "metadata": {"Type": "work"}}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:36.165255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3d5b27db-49aa-4dee-8ae5-e17a40f9e5f2 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.947726 Sep 11 10:46:36.165255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Sun Sep 11 10:46:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2950 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 10:46:36.182781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0944c73b-3d14-468e-b909-781af807ff68 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea53a0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:36.276013 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0944c73b-3d14-468e-b909-781af807ff68 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 200 len: 344 microversion: 2.1 time: 0.098101 Sep 11 10:46:36.277193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:36 2022] GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:36.615313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0113d6b1-b7d9-4519-b550-4ea8259778ac tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.306607 Sep 11 10:46:36.615965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1156 bytes} [Sun Sep 11 10:46:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2310 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 11 10:46:36.630339 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-97baf593-06cb-4123-8ee6-6ecf7391a5be tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0ea5a60>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:36.695542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-97baf593-06cb-4123-8ee6-6ecf7391a5be tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.068768 Sep 11 10:46:36.696110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:36 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:37.301270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96157ead-6e31-4fd2-913f-268db8de022e tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea7310>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:37.418858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96157ead-6e31-4fd2-913f-268db8de022e tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 200 len: 345 microversion: 2.1 time: 0.130236 Sep 11 10:46:37.421246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 2/5] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:37 2022] GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:37.437602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-df87e8a2-7f3c-4115-bb38-71228559a545 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Action: 'create', calling method: .version_select at 0x7f75a0e41160>, body: {"snapshot": {"volume_id": "cc8cbd49-e250-44f9-8f39-08d397c0c408", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-941496321"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:37.710209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b48bb99c-a711-433d-ae54-f92f5075f491 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0ea7a60>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:37.990372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-df87e8a2-7f3c-4115-bb38-71228559a545 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.558391 Sep 11 10:46:37.991544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 4/6] 10.222.0.15 () {60 vars in 1162 bytes} [Sun Sep 11 10:46:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:37.997723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4783cd5c-bff7-4b9f-a2aa-1d8ad86a8c16 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0e418b0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.019873 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b48bb99c-a711-433d-ae54-f92f5075f491 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 354 microversion: 2.1 time: 0.313124 Sep 11 10:46:38.021289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:37 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.033315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-15d9f9e4-5356-45bf-be7c-3779be66a335 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e37160>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.162792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4783cd5c-bff7-4b9f-a2aa-1d8ad86a8c16 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/73b2ebbc-d42a-4081-b96e-4b39ab7ba9e9" status: 200 len: 350 microversion: 2.1 time: 0.169720 Sep 11 10:46:38.163345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:37 2022] GET /compute/v2.1/os-volumes/73b2ebbc-d42a-4081-b96e-4b39ab7ba9e9 => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.168005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4f1efda5-e09d-419c-b703-8c744a890f2e tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a1801790>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.234539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-15d9f9e4-5356-45bf-be7c-3779be66a335 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.212063 Sep 11 10:46:38.235273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 4/9] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:38 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.246904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9e980131-cd5c-42c5-abff-432310869aa0 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea7d30>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.317699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4f1efda5-e09d-419c-b703-8c744a890f2e tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 354 microversion: 2.1 time: 0.153105 Sep 11 10:46:38.318255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:38 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.337302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-19a20cbf-0ee9-4ee8-b8e7-fa78ad21d3a4 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0ea5dc0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.425987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9e980131-cd5c-42c5-abff-432310869aa0 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.182651 Sep 11 10:46:38.427032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1140 bytes} [Sun Sep 11 10:46:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.440417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c1abf3fd-477c-4eed-8a71-5743fbda3d76 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e37670>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.529540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-19a20cbf-0ee9-4ee8-b8e7-fa78ad21d3a4 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 202 len: 0 microversion: 2.1 time: 0.196496 Sep 11 10:46:38.530877 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:46:38 2022] DELETE /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:46:38.538881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-38e18988-2f61-4486-bbde-e0fb6c634545 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0e41af0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:38.608068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c1abf3fd-477c-4eed-8a71-5743fbda3d76 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.173323 Sep 11 10:46:38.609419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:38 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:38.683071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-38e18988-2f61-4486-bbde-e0fb6c634545 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.148186 Sep 11 10:46:38.683660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:38 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:46:39.622843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-45442644-8d4e-42e8-a49c-4c72884599e5 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e37dc0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:39.674028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-45442644-8d4e-42e8-a49c-4c72884599e5 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.054947 Sep 11 10:46:39.674591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:39 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:39.702061 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dbf23b84-407d-464d-a02e-434c8b0f7b85 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0e41790>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:39.812347 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dbf23b84-407d-464d-a02e-434c8b0f7b85 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.118221 Sep 11 10:46:39.813408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:39 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:40.686432 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ac69004a-5ec0-4f33-94fa-8fc9b9ea80ea tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea71f0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:40.769570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ac69004a-5ec0-4f33-94fa-8fc9b9ea80ea tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.086294 Sep 11 10:46:40.771472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:40 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:40.828664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-283ec5d1-87b8-4a38-a13d-b5c86e32ad48 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0ea59d0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:40.960560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-283ec5d1-87b8-4a38-a13d-b5c86e32ad48 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.135810 Sep 11 10:46:40.961432 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:40 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:41.783868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f2b9d9d2-8b78-4fe4-a820-452a3f26488b tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea7ca0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:41.858364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f2b9d9d2-8b78-4fe4-a820-452a3f26488b tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.078719 Sep 11 10:46:41.859179 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:41 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:41.980261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-06118dcd-6148-40e6-9a75-121de807fda4 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0e41ca0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:42.092171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-06118dcd-6148-40e6-9a75-121de807fda4 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.121689 Sep 11 10:46:42.093134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 11/20] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:41 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:42.873428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ffb62c52-4261-49b2-a296-734036b3055b tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e37d30>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:42.933100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ffb62c52-4261-49b2-a296-734036b3055b tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.063655 Sep 11 10:46:42.933690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 10/21] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:42 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:43.119773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-11da2fc2-653d-4790-8971-f5d08cac763b tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0e41430>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:43.240982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-11da2fc2-653d-4790-8971-f5d08cac763b tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.136852 Sep 11 10:46:43.241548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:43 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:43.857874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cdcc7222-0711-45f1-bb75-a99e18fe9dfe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: .version_select at 0x7f75a0e37670>, body: {"keypair": {"name": "tempest-keypair-1832666301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF9Cize7aTSLM84vntgUVSloZDdo6E7GGS3V2bfsWTbgibJ5MzGRjpzcNacgDrIw02ufxRrWeuu+RVhro6R5dRxh2u/v5TgmQR+10aejZmpTaV1JrqHoYIqyvUbp9Tduw=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:43.945914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2e83f4c3-4c7c-468f-8eca-c62f2e564a4d tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea5d30>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:43.981904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-cdcc7222-0711-45f1-bb75-a99e18fe9dfe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:44.006224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-cdcc7222-0711-45f1-bb75-a99e18fe9dfe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for user 8d0af2b5f354439d92bfa317a0baefd5 and project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:44.041186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2e83f4c3-4c7c-468f-8eca-c62f2e564a4d tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.099151 Sep 11 10:46:44.042258 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:43 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:44.108904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cdcc7222-0711-45f1-bb75-a99e18fe9dfe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.783010 Sep 11 10:46:44.111043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 11/24] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:46:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:44.254772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-134d99f0-2bc2-48f8-895a-3d77778c6e7b tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0ea5700>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:44.431112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-134d99f0-2bc2-48f8-895a-3d77778c6e7b tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 200 len: 353 microversion: 2.1 time: 0.180081 Sep 11 10:46:44.431939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:44 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:45.055923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fa9f658b-b348-4f77-bd92-c6874631d712 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e27700>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:45.132802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fa9f658b-b348-4f77-bd92-c6874631d712 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 287 microversion: 2.1 time: 0.081727 Sep 11 10:46:45.134184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:45 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:46:45.150137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-88f493ac-1f3f-4711-9189-ce9b2c5f83da tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e411f0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:45.360617 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-88f493ac-1f3f-4711-9189-ce9b2c5f83da tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 202 len: 0 microversion: 2.1 time: 0.211769 Sep 11 10:46:45.361109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1254 bytes} [Sun Sep 11 10:46:45 2022] DELETE /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:46:45.373732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6b4ada1b-8cb4-4715-b0b1-38ea2bc5c6d9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e27d30>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:45.447188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6b4ada1b-8cb4-4715-b0b1-38ea2bc5c6d9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 200 len: 286 microversion: 2.1 time: 0.080369 Sep 11 10:46:45.448101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:45 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:45.450017 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8d3a72a4-6e7d-42ad-8574-bc7447d14442 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Calling method '.version_select at 0x7f75a0e414c0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:45.512824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-8d3a72a4-6e7d-42ad-8574-bc7447d14442 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] HTTP exception thrown: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8d3a72a4-6e7d-42ad-8574-bc7447d14442 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Request method failure captured: Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc HTTP/1.1 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyK-2sK7lMRmvHxHmlQfvi8Ucd4nrwrkrFv549o2FCivNuco2k0pqk2Blc-sxrR2PD1mP5YD8Rqpp_RGkbK4w2Lvdi1O2nHC9ALMTuqE-ht9d3ddqg0J_HftFhjSvABEpixCVC0juz8jGsrBSd0enXTIFfJR9GK9SFiK1tkdXwJcug Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 22d7f01aefde4648ac6332e67d622214 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesGetTestJSON-1661044290 Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:46:45.525428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22d7f01aefde4648ac6332e67d622214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22d7f01aefde4648ac6332e67d622214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22d7f01aefde4648ac6332e67d622214", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22d7f01aefde4648ac6332e67d622214"}]}] Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesGetTestJSON-1661044290 Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 22d7f01aefde4648ac6332e67d622214 Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesGetTestJSON-1661044290 Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesGetTestJSON-1661044290-project Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 1eb7a55cacf3400cbbdead369f9f65e7 Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesGetTestJSON-1661044290-project Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '3c0cf514-3605-4d75-9968-e3f544fac1dc'} Sep 11 10:46:45.526641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. (HTTP 404) (Request-ID: req-a164b766-59e6-4ece-84bc-39eba6d0df85) Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:45.527298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:45.528348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 10:46:45.529273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8d3a72a4-6e7d-42ad-8574-bc7447d14442 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] Returning 404 to user: Volume 3c0cf514-3605-4d75-9968-e3f544fac1dc could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:46:45.530188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8d3a72a4-6e7d-42ad-8574-bc7447d14442 tempest-VolumesGetTestJSON-1661044290 tempest-VolumesGetTestJSON-1661044290-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc" status: 404 len: 109 microversion: 2.1 time: 0.086273 Sep 11 10:46:45.538098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:45 2022] GET /compute/v2.1/os-volumes/3c0cf514-3605-4d75-9968-e3f544fac1dc => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:46:45.667116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b671a362-9774-48d5-b07b-c6244c49e0b1 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0e27dc0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:45.809424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b671a362-9774-48d5-b07b-c6244c49e0b1 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f9593ad5-b6d6-45b2-929d-7e4061060e1e" status: 200 len: 351 microversion: 2.1 time: 0.146846 Sep 11 10:46:45.810011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 14/30] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:45 2022] GET /compute/v2.1/os-volumes/f9593ad5-b6d6-45b2-929d-7e4061060e1e => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:46:46.459465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-189363d9-6fdc-4e88-aada-a0f2715e8166 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea5d30>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:46.533560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-189363d9-6fdc-4e88-aada-a0f2715e8166 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] HTTP exception thrown: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-189363d9-6fdc-4e88-aada-a0f2715e8166 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Request method failure captured: Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 HTTP/1.1 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyJKYIG60Gw9YidFp3T-lg1oC8tf3SsGHVXWFnyO7OaVPTdolDsLsSiWGRwnB2AUWwnu2-WJFVrKxO10-uUa4v9zqPEVYBH6vm_rfe8jhKHmeoqjpk6sf-mJcnKJc9B2kWYRF5jUnhwqkzS2r95rdTUTeqg5aCi_EOdrfXXKws_mJM Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:46:46.536451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfc31fd786a54975ae40a9f4c1c2c8e4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}] Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2540f47512f74979948ba4ffa3f0415f Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'd6875edc-43cf-4a42-bfa5-7400758216c3'} Sep 11 10:46:46.537563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. (HTTP 404) (Request-ID: req-42bf3448-7548-43b2-8c92-be02d5b3dfea) Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.538384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:46.542537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 10:46:46.543739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-189363d9-6fdc-4e88-aada-a0f2715e8166 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Returning 404 to user: Snapshot d6875edc-43cf-4a42-bfa5-7400758216c3 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:46:46.545754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-189363d9-6fdc-4e88-aada-a0f2715e8166 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3" status: 404 len: 111 microversion: 2.1 time: 0.082747 Sep 11 10:46:46.547090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 17/31] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:46:46 2022] GET /compute/v2.1/os-snapshots/d6875edc-43cf-4a42-bfa5-7400758216c3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:46:46.547208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-579438c6-53e1-47e3-9ea5-20281da7834d tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0e27700>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:46.727041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-579438c6-53e1-47e3-9ea5-20281da7834d tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 202 len: 0 microversion: 2.1 time: 0.183986 Sep 11 10:46:46.727753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:46:46 2022] DELETE /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:46:46.740031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-64934eb2-8b24-417e-88a8-8ebef92ed511 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0ea5790>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:46.829340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-64934eb2-8b24-417e-88a8-8ebef92ed511 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 200 len: 344 microversion: 2.1 time: 0.096928 Sep 11 10:46:46.829888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:46 2022] GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:47.635813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3ea74f47-7e80-46fb-89f4-01bd0317e221 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0dd7280>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:47.790033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3ea74f47-7e80-46fb-89f4-01bd0317e221 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b45d15db-e25b-420d-a84a-3301cf955174" status: 200 len: 351 microversion: 2.1 time: 0.161396 Sep 11 10:46:47.791375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 16/34] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:47 2022] GET /compute/v2.1/os-volumes/b45d15db-e25b-420d-a84a-3301cf955174 => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:47.811020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0f09b0c2-4e81-455b-8366-e2fdc7034211 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0ea7310>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.000449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2807d35e-76f1-4cc2-8916-57a9314b2342 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: .version_select at 0x7f75a0e2e8b0>, body: {"keypair": {"name": "tempest-keypair-361815833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjH0QkmEsEwDWRM0UFp/el4ONwI3YX5UD4MXuIwp2/gUBevmjmz1aA/PqfB32o5nfmhnWI+RPP36TUwcm6gMIXF34HiXzJOPAbI27JSj/g2KZiDyCE0swHDgPQzf1CShA=="}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:48.060442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0f09b0c2-4e81-455b-8366-e2fdc7034211 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.256159 Sep 11 10:46:48.061695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1134 bytes} [Sun Sep 11 10:46:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:48.067758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-28ba258e-fa4e-42f7-a196-76ae7522bfb9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0dd7940>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.134117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-28ba258e-fa4e-42f7-a196-76ae7522bfb9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] HTTP exception thrown: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-28ba258e-fa4e-42f7-a196-76ae7522bfb9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Request method failure captured: Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 HTTP/1.1 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyJKYIG60Gw9YidFp3T-lg1oC8tf3SsGHVXWFnyO7OaVPTdolDsLsSiWGRwnB2AUWwnu2-WJFVrKxO10-uUa4v9zqPEVYBH6vm_rfe8jhKHmeoqjpk6sf-mJcnKJc9B2kWYRF5jUnhwqkzS2r95rdTUTeqg5aCi_EOdrfXXKws_mJM Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:46:48.140464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfc31fd786a54975ae40a9f4c1c2c8e4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}] Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 2540f47512f74979948ba4ffa3f0415f Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'cc8cbd49-e250-44f9-8f39-08d397c0c408'} Sep 11 10:46:48.142093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. (HTTP 404) (Request-ID: req-a8f3c97e-772e-4471-92ad-16ad98b5d69d) Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.142786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:48.143822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 10:46:48.144729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.145733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.148264 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-28ba258e-fa4e-42f7-a196-76ae7522bfb9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Returning 404 to user: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:46:48.149458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-28ba258e-fa4e-42f7-a196-76ae7522bfb9 tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 404 len: 109 microversion: 2.1 time: 0.086583 Sep 11 10:46:48.152380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:46:48.164172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-2807d35e-76f1-4cc2-8916-57a9314b2342 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:48.171208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0b05fa80-c3cc-42e6-aa32-75b83d6b8c74 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0dd7790>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.180911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-2807d35e-76f1-4cc2-8916-57a9314b2342 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for user 2238a62cbf1846999b31ea9434b67743 and project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:48.254731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2807d35e-76f1-4cc2-8916-57a9314b2342 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.595198 Sep 11 10:46:48.258883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 19/37] 10.222.0.15 () {62 vars in 1200 bytes} [Sun Sep 11 10:46:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 600 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 10:46:48.276526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4511f004-9d5b-4966-87d9-8bb34c4144ec tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0db34c0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.366894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-4511f004-9d5b-4966-87d9-8bb34c4144ec tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] HTTP exception thrown: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4511f004-9d5b-4966-87d9-8bb34c4144ec tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Request method failure captured: Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 HTTP/1.1 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyJKYIG60Gw9YidFp3T-lg1oC8tf3SsGHVXWFnyO7OaVPTdolDsLsSiWGRwnB2AUWwnu2-WJFVrKxO10-uUa4v9zqPEVYBH6vm_rfe8jhKHmeoqjpk6sf-mJcnKJc9B2kWYRF5jUnhwqkzS2r95rdTUTeqg5aCi_EOdrfXXKws_mJM Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:46:48.371966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfc31fd786a54975ae40a9f4c1c2c8e4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}] Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2540f47512f74979948ba4ffa3f0415f Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'cc8cbd49-e250-44f9-8f39-08d397c0c408'} Sep 11 10:46:48.373307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. (HTTP 404) (Request-ID: req-2529f133-16cb-4a88-9c8f-d8cf29b92233) Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.374128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:46:48.375297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 10:46:48.376586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.380459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4511f004-9d5b-4966-87d9-8bb34c4144ec tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Returning 404 to user: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:46:48.381479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4511f004-9d5b-4966-87d9-8bb34c4144ec tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 404 len: 109 microversion: 2.1 time: 0.119854 Sep 11 10:46:48.382766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 20/38] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:46:48 2022] DELETE /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:46:48.392773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a0f6b61a-bc30-40eb-8f88-06cf70c5e17c tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Calling method '.version_select at 0x7f75a0db33a0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.425593 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0b05fa80-c3cc-42e6-aa32-75b83d6b8c74 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.271077 Sep 11 10:46:48.426975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1149 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:48.442078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0a901b57-e11b-452c-85b2-ac3f60667d8f tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0d42040>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.461761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-a0f6b61a-bc30-40eb-8f88-06cf70c5e17c tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] HTTP exception thrown: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a0f6b61a-bc30-40eb-8f88-06cf70c5e17c tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Request method failure captured: Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 HTTP/1.1 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyJKYIG60Gw9YidFp3T-lg1oC8tf3SsGHVXWFnyO7OaVPTdolDsLsSiWGRwnB2AUWwnu2-WJFVrKxO10-uUa4v9zqPEVYBH6vm_rfe8jhKHmeoqjpk6sf-mJcnKJc9B2kWYRF5jUnhwqkzS2r95rdTUTeqg5aCi_EOdrfXXKws_mJM Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:46:48.465833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfc31fd786a54975ae40a9f4c1c2c8e4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfc31fd786a54975ae40a9f4c1c2c8e4"}]}] Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: cfc31fd786a54975ae40a9f4c1c2c8e4 Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148442611 Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2540f47512f74979948ba4ffa3f0415f Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148442611-project Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'cc8cbd49-e250-44f9-8f39-08d397c0c408'} Sep 11 10:46:48.466899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. (HTTP 404) (Request-ID: req-6cd77b3c-121b-448c-b33b-8ffc81182e7f) Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.468489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:46:48.469393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 10:46:48.470284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. Sep 11 10:46:48.471167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:46:48.474422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a0f6b61a-bc30-40eb-8f88-06cf70c5e17c tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] Returning 404 to user: Volume cc8cbd49-e250-44f9-8f39-08d397c0c408 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:46:48.475553 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a0f6b61a-bc30-40eb-8f88-06cf70c5e17c tempest-VolumesSnapshotsTestJSON-1148442611 tempest-VolumesSnapshotsTestJSON-1148442611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408" status: 404 len: 109 microversion: 2.1 time: 0.089096 Sep 11 10:46:48.476715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes/cc8cbd49-e250-44f9-8f39-08d397c0c408 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:46:48.683121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0a901b57-e11b-452c-85b2-ac3f60667d8f tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245452 Sep 11 10:46:48.684749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1134 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:48.699653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bd18b6f4-9808-4f5d-8a63-b391a36c536e tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0db3d30>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:48.921465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bd18b6f4-9808-4f5d-8a63-b391a36c536e tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.227106 Sep 11 10:46:48.922032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 22/42] 10.222.0.15 () {58 vars in 1167 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:48.936881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f57cc104-be82-4acb-af6c-d68d5cfffedb tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0d42ca0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:49.197346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f57cc104-be82-4acb-af6c-d68d5cfffedb tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.264879 Sep 11 10:46:49.197912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1170 bytes} [Sun Sep 11 10:46:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:49.213746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-70ebd0e3-5500-4c50-950f-194eefa2f0fd tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0d53af0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:49.476926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-70ebd0e3-5500-4c50-950f-194eefa2f0fd tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.267488 Sep 11 10:46:49.478109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1155 bytes} [Sun Sep 11 10:46:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:49.492292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-32ae77c1-9fcc-46ee-a858-112bcbcb7214 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0d46040>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:49.805387 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-32ae77c1-9fcc-46ee-a858-112bcbcb7214 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317513 Sep 11 10:46:49.806613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1188 bytes} [Sun Sep 11 10:46:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:46:49.822207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-efe3b0b5-69cf-4fc0-8bf0-6c55785d7459 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] Calling method '.version_select at 0x7f75a0d47e50>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:50.013618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-efe3b0b5-69cf-4fc0-8bf0-6c55785d7459 tempest-VolumesTestJSON-1025863215 tempest-VolumesTestJSON-1025863215-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.196733 Sep 11 10:46:50.015159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 24/46] 10.222.0.15 () {58 vars in 1155 bytes} [Sun Sep 11 10:46:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:46:51.141352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1060410685", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:51.333850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] validate_networks() for [('956ffae6-3fba-406d-940b-dead7ebd6612', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:46:53.293736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:46:53.294576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:46:53.296326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:46:53.296965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:46:53.297684 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:46:53.355231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:53.361356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:53.362690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:53.366643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:53.368530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:53.369082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:53.495750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:53.507370 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for user f6eaba3a278e4bc99aca0dedd649fa9f and project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:53.550574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:46:53.559713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:46:53.746913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ce7e38b-24ec-4c9a-beb8-36cba5d6609b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.211471 Sep 11 10:46:53.747577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:46:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:46:53.763803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cfba2be2-1c0b-4e0a-a276-042cbe659001 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:53.764421 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cfba2be2-1c0b-4e0a-a276-042cbe659001 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:53.928572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-348088646", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "networks": [{"uuid": "80c9af0c-a74a-4a0a-9204-f245525cf8fd"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:54.110120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cfba2be2-1c0b-4e0a-a276-042cbe659001 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:54.136380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cfba2be2-1c0b-4e0a-a276-042cbe659001 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1222 microversion: 2.1 time: 0.376803 Sep 11 10:46:54.156388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:46:53 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1222 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:54.262572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] validate_networks() for [('80c9af0c-a74a-4a0a-9204-f245525cf8fd', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:46:54.322843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1485657597", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bfe408-3793-49e5-b0a4-b09176d5b63d"}], "security_groups": [{"name": "tempest-securitygroup--1849767494"}], "key_name": "tempest-keypair-1832666301", "user_data": "}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:54.749655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] validate_networks() for [('d8bfe408-3793-49e5-b0a4-b09176d5b63d', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:46:55.869931 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:46:55.870529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:46:55.870991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:46:55.871406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:46:55.871905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:46:55.896435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:55.904995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:55.905807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:55.910036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:55.910833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:55.911850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:55.986654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:55.997497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for user 8d0af2b5f354439d92bfa317a0baefd5 and project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:56.042836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:46:56.052578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:46:56.207250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b5aa8667-4825-400b-82ab-b87c6e043f7c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.910677 Sep 11 10:46:56.207934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:46:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:46:56.223231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1355814421", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:56.378471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] validate_networks() for [('956ffae6-3fba-406d-940b-dead7ebd6612', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:46:56.966831 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:46:56.967982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:46:56.968680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:46:56.969458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:46:56.970218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:46:57.000859 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:57.001528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:57.002296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:57.003980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:57.004608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:57.005192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:57.058769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Getting quotas for project 74e895a982b34e958af26f5287567949. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:57.068266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Getting quotas for user ea9f58a33d1449099bd39f8d09f9f0cd and project 74e895a982b34e958af26f5287567949. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:57.130302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:46:57.138482 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:46:57.386971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e061cef4-f2f2-4c5e-a84c-683f66765c10 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.228073 Sep 11 10:46:57.409276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:46:57.441778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2047858229", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88c1fa28-e5ca-496f-ae84-b3828068ab9b"}], "security_groups": [{"name": "tempest-securitygroup--451081363"}], "key_name": "tempest-keypair-361815833", "user_data": "}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:46:57.806531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] validate_networks() for [('88c1fa28-e5ca-496f-ae84-b3828068ab9b', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:46:57.946779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:46:57.947377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:46:57.947683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:46:57.948095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:46:57.948886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:46:57.981249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:57.981991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:57.982425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:57.983248 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:57.997606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:57.998182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.064834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:58.082041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for user f6eaba3a278e4bc99aca0dedd649fa9f and project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:58.115974 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:46:58.118284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:46:58.233882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-49d846ae-5bed-4f89-b6b9-50a19c1912a8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.015381 Sep 11 10:46:58.235105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:46:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:46:58.250779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:58.259047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:58.289231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.289769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.290219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.290952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.291408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.296950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.714213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:58.754660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3150bc6d-7565-49e7-bd7d-20c64e65e6e0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1242 microversion: 2.1 time: 0.518236 Sep 11 10:46:58.755486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:46:58 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1242 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:58.767066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:58.767710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:58.789083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.789590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.790023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.797764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.798491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.799222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.967812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:46:58.968776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:46:58.969412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:46:58.969891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:46:58.970248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:46:58.986710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:58.990583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.991130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.991889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.993145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:58.993930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:58.994443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:58.996279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5e7f614f-53a5-4f30-9b2b-dcd8a7d7600f tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1218 microversion: 2.1 time: 0.239990 Sep 11 10:46:58.996861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 28/53] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:46:58 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:59.016596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-143c4a0f-d010-4f35-a686-44e672d61a26 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:59.020134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-143c4a0f-d010-4f35-a686-44e672d61a26 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:59.053531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:46:59.066544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for user 2238a62cbf1846999b31ea9434b67743 and project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:46:59.121976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:46:59.137715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:46:59.198789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-143c4a0f-d010-4f35-a686-44e672d61a26 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:59.210118 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-143c4a0f-d010-4f35-a686-44e672d61a26 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1222 microversion: 2.1 time: 0.212214 Sep 11 10:46:59.221304 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:46:58 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:46:59.323608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cbb7611c-7eb5-4f27-9b30-79ca62887c67 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.907160 Sep 11 10:46:59.327839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 26/55] 10.222.0.15 () {62 vars in 1188 bytes} [Sun Sep 11 10:46:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 10:46:59.352018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:59.353848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:59.713509 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:59.728218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:59.733494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:46:59.736165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-088ff15d-eccd-4fe4-94c7-418100702de5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1281 microversion: 2.20 time: 0.399316 Sep 11 10:46:59.737588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:46:59 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1281 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:46:59.779400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:46:59.781854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:46:59.799505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:59.802072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:59.803556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:46:59.804963 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:46:59.806780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:46:59.808383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.008767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.020399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3c6f8dbf-67c8-4666-a048-15287c7959ce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1242 microversion: 2.1 time: 0.245952 Sep 11 10:47:00.023857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 31/57] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:46:59 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1242 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:00.042462 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.043186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:00.067117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.068342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.069641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.073558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.075120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.077057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.183845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.196704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-51ac53cb-5bbf-4925-b341-726ab5b495d5 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Action: 'create', calling method: .version_select at 0x7f75a0d47d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1352545013", "metadata": {"Type": "work"}}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:00.198362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-231edf3d-ab5c-4de9-9979-315644a5e8ec tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1218 microversion: 2.1 time: 0.172733 Sep 11 10:47:00.201892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 32/58] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:00 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-51ac53cb-5bbf-4925-b341-726ab5b495d5 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 122 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:47:00.223012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1352545013", "metadata": {"Type": "work"}}} Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: Sep 11 10:47:00.224676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1352545013', 'metadata': {'Type': 'work'}}}} Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise error Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.225528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 10:47:00.226944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 10:47:00.228144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 10:47:00.228144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.230237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-51ac53cb-5bbf-4925-b341-726ab5b495d5 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.231437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-51ac53cb-5bbf-4925-b341-726ab5b495d5 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.583797 Sep 11 10:47:00.233326 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 27/59] 10.222.0.15 () {60 vars in 1156 bytes} [Sun Sep 11 10:46:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 586 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:47:00.242921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d3d48b16-c902-483e-959a-9c471d5695ad tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Action: 'create', calling method: .version_select at 0x7f75a03b6e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1743815857", "metadata": {"Type": "work"}}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d3d48b16-c902-483e-959a-9c471d5695ad tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 120 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:47:00.254561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1743815857", "metadata": {"Type": "work"}}} Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:47:00.255901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1743815857', 'metadata': {'Type': 'work'}}}} Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise error Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi '0' Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.256730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 10:47:00.258171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 10:47:00.259776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 10:47:00.259776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.265294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d3d48b16-c902-483e-959a-9c471d5695ad tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.270233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d3d48b16-c902-483e-959a-9c471d5695ad tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031677 Sep 11 10:47:00.272869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 33/60] 10.222.0.15 () {60 vars in 1156 bytes} [Sun Sep 11 10:47:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:47:00.274718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.275513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:00.282602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2fbab5be-7221-43ba-b89b-7320e4b718fa tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Action: 'create', calling method: .version_select at 0x7f75a040e790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1907342814", "metadata": {"Type": "work"}}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2fbab5be-7221-43ba-b89b-7320e4b718fa tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 119 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:47:00.306942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1907342814", "metadata": {"Type": "work"}}} Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:47:00.308057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1907342814', 'metadata': {'Type': 'work'}}}} Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise error Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi '' Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.308731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 10:47:00.322666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 10:47:00.323983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 10:47:00.323983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.328342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2fbab5be-7221-43ba-b89b-7320e4b718fa tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.335725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2fbab5be-7221-43ba-b89b-7320e4b718fa tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.054487 Sep 11 10:47:00.336845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 34/61] 10.222.0.15 () {60 vars in 1156 bytes} [Sun Sep 11 10:47:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:47:00.350790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25c112fe-faeb-4456-bdbc-c7426fbc24b4 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Calling method '.version_select at 0x7f75a03d6820>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.352987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.353804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.354413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.355774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.357859 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.358813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.491143 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-25c112fe-faeb-4456-bdbc-c7426fbc24b4 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] HTTP exception thrown: Volume tempest-invalid-424314264 could not be found. Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25c112fe-faeb-4456-bdbc-c7426fbc24b4 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-424314264 HTTP/1.1 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:47:00.493833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Volume tempest-invalid-424314264 could not be found. Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'tempest-invalid-424314264'} Sep 11 10:47:00.495011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-424314264 could not be found. (HTTP 404) (Request-ID: req-a5e0c972-88d9-4151-8759-5f2dbc08d9f5) Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.495825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:47:00.498027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-424314264 could not be found. Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:47:00.500206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-424314264 could not be found. Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-424314264 could not be found. Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25c112fe-faeb-4456-bdbc-c7426fbc24b4 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 404 to user: Volume tempest-invalid-424314264 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-25c112fe-faeb-4456-bdbc-c7426fbc24b4 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-424314264" status: 404 len: 98 microversion: 2.1 time: 0.151842 Sep 11 10:47:00.502860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 35/62] 10.222.0.15 () {58 vars in 1215 bytes} [Sun Sep 11 10:47:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-424314264 => generated 98 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 11 10:47:00.507076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cbcd6934-2cee-4b01-970b-e21c5768ae4b tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004091 Sep 11 10:47:00.507867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 36/63] 10.222.0.15 () {58 vars in 1140 bytes} [Sun Sep 11 10:47:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 11 10:47:00.523308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-331dc227-76b5-438b-90d7-bd6d7bef0533 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 Sep 11 10:47:00.524025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 37/64] 10.222.0.15 () {58 vars in 1137 bytes} [Sun Sep 11 10:47:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 10:47:00.532766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f9f3ef40-955d-494e-966c-3a7471111497 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Calling method '.version_select at 0x7f75a0496310>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.600227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-f9f3ef40-955d-494e-966c-3a7471111497 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] HTTP exception thrown: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f9f3ef40-955d-494e-966c-3a7471111497 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/os-volumes/ed966234-5af8-46bd-bd58-13b8d7e6cd92 HTTP/1.1 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:47:00.602604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'ed966234-5af8-46bd-bd58-13b8d7e6cd92'} Sep 11 10:47:00.604524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. (HTTP 404) (Request-ID: req-96501d24-c260-4fee-a088-dc4426c8f53c) Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.605540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 10:47:00.607362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 10:47:00.608845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f9f3ef40-955d-494e-966c-3a7471111497 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 404 to user: Volume ed966234-5af8-46bd-bd58-13b8d7e6cd92 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f9f3ef40-955d-494e-966c-3a7471111497 tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/ed966234-5af8-46bd-bd58-13b8d7e6cd92" status: 404 len: 109 microversion: 2.1 time: 0.075369 Sep 11 10:47:00.610210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 38/65] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:47:00 2022] DELETE /compute/v2.1/os-volumes/ed966234-5af8-46bd-bd58-13b8d7e6cd92 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:47:00.615372 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-395a4027-aea5-487f-a4d3-47da92633d5a tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Calling method '.version_select at 0x7f75a0496790>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.638628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.651357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-395a4027-aea5-487f-a4d3-47da92633d5a tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] HTTP exception thrown: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-395a4027-aea5-487f-a4d3-47da92633d5a tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Request method failure captured: Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/os-volumes/fddeeb1b-73bd-492c-bd97-38a0b2f1e509 HTTP/1.1 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyj028D9qSCz5ST7vqLoBg0qU8eJ81cjriW_3w_THY79WbtEU575zJG2eCqFNlAeL2aWw1XUFlSG39hr01hWzhaKm_ke9TYCl2kTAyGNUyhbOjlp8ETRjBzP6ayxo1WqZTjirq6UwkmpP60_RU8YcU0P4sDcpFxb0O4kOdBIc0Tjf0 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:47:00.653447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4faa31fc51a348a4accee557406bbc5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4faa31fc51a348a4accee557406bbc5a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4faa31fc51a348a4accee557406bbc5a"}]}] Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 4faa31fc51a348a4accee557406bbc5a Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesNegativeTest-226391961 Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e0f337fe25d74a069a1c65029264f5fe Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesNegativeTest-226391961-project Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'fddeeb1b-73bd-492c-bd97-38a0b2f1e509'} Sep 11 10:47:00.654550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. (HTTP 404) (Request-ID: req-0b2974a7-3ba3-4f32-9077-6a6ef8d0149e) Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.655233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 10:47:00.656259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 10:47:00.657183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-395a4027-aea5-487f-a4d3-47da92633d5a tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] Returning 404 to user: Volume fddeeb1b-73bd-492c-bd97-38a0b2f1e509 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-395a4027-aea5-487f-a4d3-47da92633d5a tempest-VolumesNegativeTest-226391961 tempest-VolumesNegativeTest-226391961-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fddeeb1b-73bd-492c-bd97-38a0b2f1e509" status: 404 len: 109 microversion: 2.1 time: 0.044089 Sep 11 10:47:00.658145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 39/66] 10.222.0.15 () {58 vars in 1245 bytes} [Sun Sep 11 10:47:00 2022] GET /compute/v2.1/os-volumes/fddeeb1b-73bd-492c-bd97-38a0b2f1e509 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:47:00.663468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-11ccedf6-1cb4-4d00-98f0-090dd04ea712 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1226 microversion: 2.1 time: 0.411042 Sep 11 10:47:00.663607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 28/67] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:00 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1226 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:00.769261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:00.770263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:00.783501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.784543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.787239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.788263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:00.789040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:00.789715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:00.921811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.932158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.935301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:00.937084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-34aad751-4c03-4040-a026-04a3766f89b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1285 microversion: 2.20 time: 0.174041 Sep 11 10:47:00.969829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 40/68] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:00 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:01.051161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:01.051936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:01.072045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.072594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.073053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.073784 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.074254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.074691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.227334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:01.228048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:01.240200 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.244262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.245754 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.248839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.249496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.251073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.355771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:01.376095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8903ccac-363c-4ad3-bf9a-bbca036710fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1290 microversion: 2.1 time: 0.328827 Sep 11 10:47:01.389350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 29/69] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:01 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1290 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:01.686329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:01.686950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:01.707846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.708486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.708949 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.719197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.719729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.720172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.781464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:01.792993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e013c2e8-619a-46ba-95ec-56d384cf6cdd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1210 microversion: 2.1 time: 0.569843 Sep 11 10:47:01.795884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 41/70] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:01 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1210 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:01.879597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:01.890247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ee6e5e59-41e6-4784-8ca6-93f3bfc73032 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1218 microversion: 2.1 time: 0.207853 Sep 11 10:47:01.895346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 30/71] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:01 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:01.975324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:01.976240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:01.985013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:01.994712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:01.996996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:01.999137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.002208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.005912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.406301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:02.406978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:02.424094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.429204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.429716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.430458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.439293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.439883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.482990 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:02.504189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:02.508471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:02.512074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e87a5c81-7205-4f08-a536-bbb71a777d70 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1277 microversion: 2.20 time: 0.541222 Sep 11 10:47:02.514257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 42/72] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:01 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1277 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:02.772728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:02.787453 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3c0b1556-fa7e-4cf7-82f8-ec612a91cb39 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1308 microversion: 2.1 time: 0.385375 Sep 11 10:47:02.788429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 31/73] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:02 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:02.825434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:02.826051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:02.844533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.845039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.845473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.846183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.846699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.847122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.925233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:02.926280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:02.933669 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.934427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.935117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:02.936418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:02.938199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:02.941926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:03.755943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:03.759002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:03.770374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c921b305-2c38-4f28-91b2-0236a1c25524 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1210 microversion: 2.1 time: 0.949187 Sep 11 10:47:03.772032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d95ede3c-9de8-4c65-b990-060c725dc835 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1274 microversion: 2.1 time: 0.853232 Sep 11 10:47:03.772646 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 32/74] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:02 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1274 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:03.790198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:03.791143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:03.795044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:02 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1210 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:03.817399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:03.818005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:03.823238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:03.825207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:03.827417 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:03.828533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:03.830380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:03.831777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:03.849816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:03.850744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:03.855670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:03.860769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:03.867055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:03.868020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:04.362684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:04.379196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:04.384108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:04.385942 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-985313d5-532d-4ec3-9f94-80eba252e705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1277 microversion: 2.20 time: 0.609623 Sep 11 10:47:04.396543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 33/76] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:03 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1277 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:04.484069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:04.497951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e54d094a-73b7-443d-b658-50489f3d2411 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1296 microversion: 2.1 time: 0.686206 Sep 11 10:47:04.520475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 44/77] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:03 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1296 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:04.802418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:04.803310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:04.825435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:04.826162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:04.828536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:04.829252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:04.829911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:04.834212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:04.834941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:04.835604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:04.841632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:04.850208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:04.850708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:04.851151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:04.851901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:04.852353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:04.852776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:05.084812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.124081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-80dc9248-5293-4e2f-8417-ea9493ee772c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1280 microversion: 2.1 time: 0.327509 Sep 11 10:47:05.132592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 34/78] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:04 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:05.255148 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.270803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ee5541c-e4b4-4068-94c1-63f098693a11 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1274 microversion: 2.1 time: 0.449229 Sep 11 10:47:05.282106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 45/79] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:04 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1274 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:05.425408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:05.426316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:05.433952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:05.434737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:05.435366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:05.436339 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:05.437283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:05.438934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:05.530698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:05.531322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:05.555472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:05.563501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:05.563501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:05.563826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:05.564310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:05.564760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:05.721882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.733337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.748638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.762163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6e557667-ac51-4002-8cb1-b99a4a4ad705 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1333 microversion: 2.20 time: 0.332839 Sep 11 10:47:05.763596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 35/80] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:05 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:05.780533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:05.818993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3b779c0e-9b3c-48da-ba90-13a0eaf7fdaf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1296 microversion: 2.1 time: 0.277309 Sep 11 10:47:05.820991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 46/81] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:05 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1296 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:06.151111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:06.152810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:06.162688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:06.179907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:06.182303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:06.184019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:06.190086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:06.192638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:06.321348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:06.322655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:06.338111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:06.342626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:06.349219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:06.354000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:06.354740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:06.356309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:07.186439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.209598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.210986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2f299486-b303-43fe-a5ea-dcbd8f5da8ea tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1272 microversion: 2.1 time: 0.895877 Sep 11 10:47:07.212237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 47/82] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:06 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1272 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:07.223852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:07.226386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:07.247200 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0742408c-af33-4aab-9276-3af9c35d48f6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1280 microversion: 2.1 time: 1.099797 Sep 11 10:47:07.258740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 36/83] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:06 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1280 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:07.273014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:07.274167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:07.274516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:07.275167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:07.276168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:07.277463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:07.278446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:07.283882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:07.306962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:07.307539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:07.310049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:07.310928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:07.315843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:07.316687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:07.660848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.691274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.716765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.721577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0b4effaa-f41e-4488-8386-0a175ec0eab0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1339 microversion: 2.20 time: 0.506682 Sep 11 10:47:07.723174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 48/84] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:07 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1339 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:07.808565 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:07.827134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ae614f39-1ce4-478a-ab74-2f982daf32dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1296 microversion: 2.1 time: 0.563871 Sep 11 10:47:07.828053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 37/85] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:07 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1296 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:08.238815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:08.240319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:08.249014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:08.273761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.274265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.274701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.275414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.276105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.276530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.286901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:08.289141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:08.296440 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.304659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.305128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.305868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.306318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.316395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.742694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:08.758733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-48c95ea8-9616-4a71-ace2-cf490d0fd1e4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1272 microversion: 2.1 time: 0.523914 Sep 11 10:47:08.763193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 49/86] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:08 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1272 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:08.772052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:08.779380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:08.797959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.798453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.798904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.800308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:08.801028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:08.801457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:08.984698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:09.013349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-db23173e-a8cd-410b-83b4-844059379be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1280 microversion: 2.1 time: 0.731356 Sep 11 10:47:09.024406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 38/87] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:08 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1280 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:09.024406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:09.024406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:09.029513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=4 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.032007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:09.032984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:09.035206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:09.036392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:09.037073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:09.037968 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:09.081255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=16 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.381154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:09.413613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:09.419146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:09.420987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6514b6ff-e91f-491a-a7cd-f816fcbbbc0f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1339 microversion: 2.20 time: 0.655605 Sep 11 10:47:09.427478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 50/88] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:08 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1339 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:09.786821 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:09.788608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:09.790695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=28 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.814667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:09.815875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:09.829452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:09.831104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:09.840323 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:09.840732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:09.925328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:10.292956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.315733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f8b32ab8-950b-47cf-84af-eb129d0a6b96 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1272 microversion: 2.1 time: 0.531693 Sep 11 10:47:10.317422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 51/89] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:09 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:10.327936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:10.332323 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:10.345815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:10.346500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.348289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:10.350056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:10.352543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:10.353022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:10.353453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:10.357656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a5c3f7d9-08c1-4e32-be80-8103d023e22d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 1.340525 Sep 11 10:47:10.368445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 39/90] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:09 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:10.460610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:10.464585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:10.477311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:10.484301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:10.485082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:10.486133 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:10.486900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:10.487681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:10.734410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.759811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-785826d9-78af-4918-b6e2-2a8d04064dac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.437949 Sep 11 10:47:10.762941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 52/91] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:10 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:10.770840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.789824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.797558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:10.801782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-23408cb1-4609-482a-be3e-fc0351781e20 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1339 microversion: 2.20 time: 0.348766 Sep 11 10:47:10.807100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 40/92] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:10 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1339 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:11.340953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:11.341618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:11.368332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:11.369294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:11.372009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:11.373930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:11.374908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:11.377073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:11.398780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:11.400343 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:11.411852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:11.415055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:11.416002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:11.426091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:11.428238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:11.429719 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:11.950941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:11.961419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-80d00ccd-2f2d-4d98-8793-09db30c4bf4d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.569767 Sep 11 10:47:11.968157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 41/93] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:11 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:11.993791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:11.994499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:12.000940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:12.004345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:12.005089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:12.010139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:12.011197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:12.011965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:12.994719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:13.006788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fd8a6887-5dbb-42c6-bf27-bdf2c2b9ca2a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 1.669634 Sep 11 10:47:13.027296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 53/94] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:11 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:13.036442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:13.037274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:13.051244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:13.056406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:13.057805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:13.058778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:13.059977 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:13.063298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:13.723134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:13.738610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6428da5e-c8ae-46fb-b7d0-e3390798f498 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 1.768761 Sep 11 10:47:13.739194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 42/95] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:11 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:13.754136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:13.760499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:13.789393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:13.794530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:13.798468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:13.802490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:13.805928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:13.806979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:14.549623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:14.565325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:14.567462 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:14.569682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8b7ebe7e-b1ba-4a42-9f6c-f8a13e7d3643 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 1.540812 Sep 11 10:47:14.573888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 54/96] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:13 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:14.959987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:14.959987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:14.970786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c246e353-a327-4127-a864-c4c56d516fa8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 1.228916 Sep 11 10:47:14.973189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 43/97] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:13 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:14.977953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:14.984194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:15.004277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:15.012498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.013577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.015112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.016400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.019193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.020137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.165498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc097091-fee3-409f-89ea-48aa3782c5f5", "tag": "7f9eaa99-13c8-47df-80e2-26bdd82aecf6"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:15.189408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.191310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.192097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.230287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Creating event network-changed:7f9eaa99-13c8-47df-80e2-26bdd82aecf6 for instance fc097091-fee3-409f-89ea-48aa3782c5f5 on hv-cinder-85646 Sep 11 10:47:15.232109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=137535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 10:47:15.235023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-62f4435e-bbb2-4f72-9149-ddd2ae516a75 req-d010b670-53c3-4679-bf45-0a792ce653bf service nova] Acquired lock "compute-rpcapi-router" {{(pid=137535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 10:47:15.237209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.238799 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.239586 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.240633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.241260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.241844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.259381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.compute.rpcapi [None req-adb79ac1-3975-4780-850e-247534add02c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 10:47:15.264970 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adb79ac1-3975-4780-850e-247534add02c None None] Releasing lock "compute-rpcapi-router" {{(pid=137535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 10:47:15.295238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-adb79ac1-3975-4780-850e-247534add02c None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.718762 Sep 11 10:47:15.296260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 55/98] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:15.302395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:15.303109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:15.319262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.320117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.320953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.322035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.322846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.323770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.807878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:15.834435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-929c8a04-43e9-4d04-8dab-b28dfdcc2381 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.859206 Sep 11 10:47:15.836272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:15.848287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 44/99] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:14 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:15.862640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-68bd2976-13f9-4875-81b0-5e4a31b6a415 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.565151 Sep 11 10:47:15.864028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 56/100] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:15 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:15.874034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:15.874665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:15.891557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.893878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.896005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:15.897927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:15.899463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:15.900721 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.070695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:16.079201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:16.080772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:16.082210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a3dbc45f-897e-4476-ad07-93fb1df96946 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.216862 Sep 11 10:47:16.095756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 57/101] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:15 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:16.101617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:16.102826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:16.112465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.113057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.113620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.114638 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.115935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.116497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.390353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d30882d-5494-46e8-947a-7e3594aff794", "tag": "3454460f-90bb-469f-8e1b-684905656adc"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:16.404442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.405207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.405852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.430106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Creating event network-changed:3454460f-90bb-469f-8e1b-684905656adc for instance 0d30882d-5494-46e8-947a-7e3594aff794 on hv-cinder-85646 Sep 11 10:47:16.431188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=137534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 10:47:16.431937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-abbf1602-2783-49dd-9839-413ab22aa051 req-acf6feeb-ab27-4756-9a8f-959189f4fd81 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 10:47:16.433400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.434069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.434598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.435410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.436083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.437086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.446981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:16.449608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.compute.rpcapi [None req-bd16e473-b587-41da-82da-a652af189576 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 10:47:16.450867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd16e473-b587-41da-82da-a652af189576 None None] Releasing lock "compute-rpcapi-router" {{(pid=137534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 10:47:16.458319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ed178ca-e6c0-4bd5-85a7-657d90f19db4 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.365871 Sep 11 10:47:16.459063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 58/102] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:16 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:16.472588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bd16e473-b587-41da-82da-a652af189576 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.622849 Sep 11 10:47:16.473850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 45/103] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:16.863537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:16.864380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:16.873875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.874699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.875284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.876606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.877271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.877836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.890540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:16.891916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:16.905695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.906195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.906632 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:16.907334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:16.907876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:16.908228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.272201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.287645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b167b788-e7d1-449a-a2c2-1ddd76d87e0d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.427161 Sep 11 10:47:17.288976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 59/104] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:16 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:17.303187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:17.304157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:17.322284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:17.323016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:17.326582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.327657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:17.328291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:17.328871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.434664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.445589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dda7d41f-40a1-4506-9e1d-5b9a4549cfde tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.559115 Sep 11 10:47:17.446174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 46/105] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:16 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:17.455493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:17.467214 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:17.467735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:17.468168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.485797 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] Creating event network-changed:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:47:17.493429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-28316676-5c41-4529-b35c-e3b730b927a1 req-13a62723-5f11-4984-93a6-1a7c6b348172 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043795 Sep 11 10:47:17.496622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 47/106] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:17.507234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:17.508881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:17.520144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:17.528546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:17.529174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.530079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:17.530986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:17.531676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:17.607158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.619855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.624033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.646441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-652c318a-cc1d-48b4-9b51-e43d1ba3be59 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.350193 Sep 11 10:47:17.647076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 60/107] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:17 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:17.771466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:17.781698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4f5123c7-7150-4911-b6ed-99498ad2dff9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.282793 Sep 11 10:47:17.796144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 48/108] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:17 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:18.316682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:18.317101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:18.327752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.328192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.329013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.329732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.330722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.334300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.469406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:18.470190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:18.479636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.480144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.480592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.481306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.483398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.483870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.524116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:18.533098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-663f4755-3462-4004-ae4b-f428017cb6b3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.222133 Sep 11 10:47:18.533774 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 61/109] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:18 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:18.540407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936f747a-7ced-4807-a2fe-72d35d9b9b20", "tag": "bac56ec2-e7e9-458f-954f-675340feff36"}, {"name": "network-changed", "server_uuid": "4d911c7c-f5ff-4c56-8cc9-e0a1362c306d", "tag": "f13730d1-f81a-478d-aedf-0d6d84958ecf"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:18.553711 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.554418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.555241 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.569669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Creating event network-changed:bac56ec2-e7e9-458f-954f-675340feff36 for instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 on hv-cinder-85646 Sep 11 10:47:18.570434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] Creating event network-changed:f13730d1-f81a-478d-aedf-0d6d84958ecf for instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d on hv-cinder-85646 Sep 11 10:47:18.577577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-df4d3b70-ed0b-47d3-867b-a636dfe538dc req-d49c32d0-e0df-4cfd-98dc-0e874115b5ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042477 Sep 11 10:47:18.578904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 62/110] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:18.645703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:18.654489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2ed4457e-5036-4912-9cc9-f0468ad446a9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.189610 Sep 11 10:47:18.665633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 49/111] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:18 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:18.676365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:18.677288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:18.684125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.684693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.685346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.686136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.686660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.687154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.809388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:18.810003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:18.818253 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.818740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.819174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.820075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:18.820520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:18.821117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:18.846256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:18.858526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:18.860759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:18.862835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-40d258de-a8d1-4f44-a62d-b8cdc3bf125f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.190819 Sep 11 10:47:18.863403 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 63/112] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:18 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:19.009558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:19.018097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3a91b317-c2f8-4162-aae7-d95730c8e59f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.212548 Sep 11 10:47:19.019151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 50/113] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:18 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:19.555698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:19.556433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:19.566706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.568451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.568969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.573767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.574246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.574683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.683245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:19.683989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:19.695027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.695645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.698297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.699498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.700110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.701507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.732713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:19.745869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-38440ab3-6435-4343-ada4-1b4fc8963ba5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.194062 Sep 11 10:47:19.747492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 64/114] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:19 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:19.897937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:19.898716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:19.911231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.913051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.916367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.916869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:19.917374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:19.917836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:19.918321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:19.926945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-33f4c5a6-9bbe-4859-9288-3023db30f4b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.251545 Sep 11 10:47:19.928159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 51/115] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:19 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:20.042138 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:20.042328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:20.050732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.051315 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.052042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:20.052966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.053625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.054443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:20.337989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:20.347417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:20.349738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:20.351614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a31c2726-185c-4b75-904a-17cc722ed013 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.465864 Sep 11 10:47:20.352693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 65/116] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:19 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:20.429276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:20.442943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-11f34df9-46b4-4e20-8b38-8b2d78f6c169 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.405047 Sep 11 10:47:20.443835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 52/117] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:20 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:20.770525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:20.771193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:20.777060 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.777534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.777960 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:20.778682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.779162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.779606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:20.913515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:20.921144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-087cfea8-aef3-4b19-9449-2eb3b8f1da6a tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.154989 Sep 11 10:47:20.921846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 66/118] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:20 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:20.950559 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:20.951162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:20.957171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.957648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.958073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:20.958751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:20.959215 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:20.959657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.117090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:21.124706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9d9a6e8a-2905-4126-9201-feada5e090d8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.178407 Sep 11 10:47:21.125237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 53/119] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:20 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:21.377621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:21.378268 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:21.396315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.396315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.396315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.396315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.396609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.396609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.467348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:21.468117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:21.475460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.475980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.476563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.477280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.477800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.478374 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.613691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:21.623190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:21.625253 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:21.626672 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3c16eccc-0039-48be-a79c-e9f4fffd3d29 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.253107 Sep 11 10:47:21.628185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 67/120] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:21 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:21.644528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:21.652069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-70fad10c-7842-49ee-8e9c-3aa13f1d185d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.190035 Sep 11 10:47:21.652625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 54/121] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:21 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:21.945877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:21.947094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:21.952972 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.953463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.953897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:21.954591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:21.955697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:21.956146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.089940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.097762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e309ac14-76d0-4a5b-a417-7ed2bd27d622 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.155706 Sep 11 10:47:22.098339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 68/122] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:21 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:22.148704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:22.149431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:22.155318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.155835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.156271 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.156961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.157410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.157832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.291573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.300193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2f6a6e13-abea-4508-b94a-7963ec1c197c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.156669 Sep 11 10:47:22.300956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 55/123] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:22 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:22.653472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:22.654160 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:22.660832 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.661314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.662125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.662433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.662892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.663314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.667343 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:22.677346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:22.677953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:22.685920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.686412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.686991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.687716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:22.688162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:22.688571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:22.871876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.878873 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.881292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.882849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:22.884240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-53d4d765-a699-49f4-b015-b88cfcd64714 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.234604 Sep 11 10:47:22.885199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 69/124] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:22 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:22.898178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-44c548dc-d1c3-4097-bae9-04770b41fe59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.226308 Sep 11 10:47:22.898746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 56/125] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:22 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:23.127814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:23.128744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:23.135567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.136154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.136679 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.137455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.137982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.138466 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.290271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:23.298585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-00f5af22-0f34-40ba-ac79-41d132542618 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.175095 Sep 11 10:47:23.299961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 70/126] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:23 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:23.323139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:23.323881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:23.332146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.332761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.333553 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.334413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.335024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.335474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.467640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:23.475914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-50f5fd85-2f1a-42aa-b4e4-5c44a1c5cfea tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.156766 Sep 11 10:47:23.479829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 57/127] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:23 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:23.910321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:23.910924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:23.917024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.917619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.918975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.919707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.920165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.920588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.921071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:23.921688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:23.928565 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.929055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.929544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:23.930186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:23.930640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:23.931065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:24.110479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.114766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.119573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.121019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.122122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-90d77eb0-7723-4121-8d78-0b41df988c9e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.216564 Sep 11 10:47:24.122373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-76e61b5f-966c-4a1f-aa66-0e42281c0e59 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.205044 Sep 11 10:47:24.122669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 71/128] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:23 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:24.122920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 58/129] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:23 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:24.321702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:24.322312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:24.328188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:24.328673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:24.329107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:24.329788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:24.330767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:24.331189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:24.460637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.469957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3843646f-5a6b-4cf8-b35f-7d6d146122d0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.152095 Sep 11 10:47:24.471352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 72/130] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:24 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:24.498488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:24.499201 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:24.516871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:24.516871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:24.516871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:24.518549 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:24.519266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:24.519727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:24.652284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:24.660744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7a1f79e4-87c3-4cbb-bb52-73fcaed70ba6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.166004 Sep 11 10:47:24.661312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 59/131] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:24 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:25.147152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:25.147573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:25.147758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:25.148377 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:25.154260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.154984 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.155697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.156594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.157245 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.157934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.160186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.160675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.161121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.162310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.162818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.163787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.257244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:25.377878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:25.381724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:25.386130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:25.387597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:25.388727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2a7bdb6e-a480-420e-b01c-362014305198 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.245999 Sep 11 10:47:25.389295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 60/132] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:25 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:25.389424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ebeb4c47-f308-483c-b0cc-d38e44d8a51c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.246665 Sep 11 10:47:25.389901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 73/133] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:25 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:25.495533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:25.496139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:25.502669 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.503920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.503920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.504448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.504948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.505658 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.526940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:25.665354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:25.675757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0b6fc3e1-7d83-4357-aae0-cb2f29a2f1a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.186050 Sep 11 10:47:25.680276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 61/134] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:25 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:25.699618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:25.700312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:25.715611 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.716112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.717065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:25.717780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:25.718230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:25.718654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.043782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:26.052433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6eaa714f-d132-4c97-8265-c6664adb8d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.356508 Sep 11 10:47:26.053095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 74/135] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:25 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:26.413239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:26.413964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:26.415743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:26.416439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:26.420034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.420518 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.421006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.421829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.422343 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.422839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.424315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.424986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.425603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.426503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.426910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.428848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.453473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:26.904112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:26.911739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ce2e35ba-ac23-4bfc-963b-1f84582d5633 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.502445 Sep 11 10:47:26.912321 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 62/136] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:26 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:26.916863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:26.917471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:26.923562 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.924256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.924842 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.925708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:26.926332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:26.926895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:26.927937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:26.936753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:26.938258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:26.940096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-36a169cf-e6ad-40b4-b204-699e2ff24022 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.527525 Sep 11 10:47:26.940841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 75/137] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:26 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:27.076128 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:27.076828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:27.083501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:27.084050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:27.084482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:27.085167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:27.085613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:27.086024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:27.126999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:27.135921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4eed1933-b623-47be-8485-98bf10a2dd6c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.222484 Sep 11 10:47:27.136657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 63/138] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:26 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:27.240448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:27.250417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a351e557-4261-40a5-a597-fc7f64ede163 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.178269 Sep 11 10:47:27.251237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 76/139] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:27 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:27.935055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:27.935841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:27.942909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:27.943779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:27.944386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:27.945256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:27.945869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:27.946444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.010408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc097091-fee3-409f-89ea-48aa3782c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "7f9eaa99-13c8-47df-80e2-26bdd82aecf6"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:28.026097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.027750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.028419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.048251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] Creating event network-vif-plugged:7f9eaa99-13c8-47df-80e2-26bdd82aecf6 for instance fc097091-fee3-409f-89ea-48aa3782c5f5 on hv-cinder-85646 Sep 11 10:47:28.055739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-25716ef5-d877-4cf8-96bc-2d92c287e0fd req-0aa6f9ed-4e50-43c7-9593-9fc728bb6621 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126868 Sep 11 10:47:28.057161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 64/140] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:47:28.063240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:28.063972 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:28.072878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.073721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.074383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.076446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.077257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.077856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.119007 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.128170 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-272608a7-c392-416d-be39-a448839f5dc3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.197124 Sep 11 10:47:28.128783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 77/141] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:27 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:28.161914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:28.162837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:28.168746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.169428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.169866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.170564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.171016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.171623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.247952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.260570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.262102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.263258 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-03c109b9-da64-47a6-943d-0aee895dcf79 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.204818 Sep 11 10:47:28.276132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 65/142] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:28 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:28.282487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:28.283174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:28.290667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.291272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.291865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.292931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:28.294414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:28.294997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:28.329689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.338221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-056f2423-9ddb-42f3-9de0-758d11779da3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.183978 Sep 11 10:47:28.339048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 78/143] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:28 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:28.440371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:28.449351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9246d9c0-444d-45d2-acb8-7b9d669ca7ae tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.171703 Sep 11 10:47:28.449913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 66/144] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:28 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:29.152398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:29.153085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:29.160123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.160601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.161029 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.161710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.162153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.162573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.289746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:29.290953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:29.297912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.298119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.299322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.299860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.300905 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.301031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.301430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.306747 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-87713909-b6b5-4cb5-b7db-f9412a59b392 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.158007 Sep 11 10:47:29.307639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 79/145] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:29 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:29.363872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:29.364595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:29.370872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.371521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.372054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.373047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.373602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.374261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.474622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.483206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.484677 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.485775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cace4f5e-7917-4100-af94-7260ac5b7e3e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.199958 Sep 11 10:47:29.486872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 67/146] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:29 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:29.493119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:29.493119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:29.497921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.498411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.498874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.499603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:29.500064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:29.500490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:29.581745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.591933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-41c186db-5192-4a82-be17-d18c5f22694c tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.235043 Sep 11 10:47:29.604890 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 80/147] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:29 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:29.647570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:29.655162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e74af8c1-1700-46e5-876c-8954e1273fa9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.167353 Sep 11 10:47:29.655808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 68/148] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:29 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:30.330784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:30.331397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:30.337360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.337840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.338482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.339551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.339982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.340560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.477197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.486027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3eef109a-756e-4b7e-9a21-76265435e96d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.159685 Sep 11 10:47:30.487042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 81/149] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:30 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:30.512263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:30.512868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:30.519845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.520320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.520748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.521425 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.521869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.522282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.616494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:30.617469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:30.624358 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.624845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.625280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.625976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.626430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.627510 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.668661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.677235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.678716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.680389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f7e10c25-eb4b-45a8-9b6c-efc803371f39 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.172288 Sep 11 10:47:30.681108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 69/150] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:30 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:30.686644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:30.687478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:30.695540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.696532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.697032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.697789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:30.698304 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:30.698806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:30.864709 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.872967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-93cf076f-8143-4ec6-813e-8a5d62f7813d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.260306 Sep 11 10:47:30.873536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 82/151] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:30 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:30.887820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:30.894565 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dcdffacb-65d7-465b-9b21-24a951f0a295 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.212309 Sep 11 10:47:30.895143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 70/152] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:30 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:31.508891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:31.509497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:31.515333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.515856 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.516290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.516971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.517423 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.517841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.650112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:31.658859 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fb04c8e2-d002-40dd-aa2a-3ddd312f14c6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.153679 Sep 11 10:47:31.659437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 83/153] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:31 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:31.706224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:31.706832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:31.712870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.713438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.713939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.714688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.715208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.715722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.848451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:31.857901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:31.859382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:31.860537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bd122158-ca87-4305-a906-e99bca5a9b3c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.158274 Sep 11 10:47:31.861758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 71/154] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:31 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:31.897645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:31.898338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:31.905619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.906209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.906895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.907854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.908505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.908999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.918434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:31.919040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:31.926583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.927064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.927739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:31.928432 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:31.929042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:31.929462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:32.135736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:32.144527 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:32.144700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8df34e58-ad46-4df0-a264-e144d95fd4cd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.251281 Sep 11 10:47:32.145167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 84/155] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:31 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:32.153004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-027be7ea-fde6-4dce-a77f-1531ed89424c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.239665 Sep 11 10:47:32.153870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 72/156] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:31 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:32.686529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:32.686529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:32.688994 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:32.689481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:32.689911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:32.690644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:32.691097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:32.691544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:32.840671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:32.844095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:32.850814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7f5d4a5e-2d12-4afe-a861-76ee9fa391f1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.172306 Sep 11 10:47:32.851588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 85/157] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:32 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:32.888825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:32.889919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:32.896527 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:32.897092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:32.897601 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:32.898508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:32.899045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:32.900254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.087771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:33.098779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:33.100137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:33.101541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7faacc34-0876-4a09-b370-743f68d87b51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.217939 Sep 11 10:47:33.102094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 73/158] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:32 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:33.168458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:33.170211 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:33.175349 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.175886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.176645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.177379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.178080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.178640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.180187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:33.181003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:33.187637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.188468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.189708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.190863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.191579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.192146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.384189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:33.393447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f434fa32-a864-438f-a120-72686f4d99c5 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.229033 Sep 11 10:47:33.394466 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 86/159] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:33 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:33.408538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:33.416967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e217e8b8-0c0b-4c64-8ecd-aa11ee15cc61 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.244733 Sep 11 10:47:33.417556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 74/160] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:33 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:33.878489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:33.879673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:33.886745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.887238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.887698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:33.888385 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:33.888850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:33.889266 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.019177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.026740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-18aeffa3-d73f-49a6-a039-6e856f869fb8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.154392 Sep 11 10:47:34.027328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 87/161] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:33 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:34.127593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:34.128110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:34.134028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.134512 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.134948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.135664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.136115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.136538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.270222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.278365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.279836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.281023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c2b6d42e-277f-434b-b73f-01ac600e9bce tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.158061 Sep 11 10:47:34.291495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 75/162] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:34 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:34.418702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:34.419557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:34.425705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.426470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.427231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.428019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.428673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.429106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.444438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:34.445262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:34.452739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.453230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.454293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.455962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.456814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.457294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.657291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.668706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-20977f2a-b0ac-4a23-85a6-1768fcd773dd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.230205 Sep 11 10:47:34.669818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 76/163] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:34 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:34.677015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d30882d-5494-46e8-947a-7e3594aff794", "name": "network-vif-plugged", "status": "completed", "tag": "3454460f-90bb-469f-8e1b-684905656adc"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:34.684681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:34.689788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:34.690793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:34.691607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:34.693743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cc7d0cac-1294-4988-bec2-f30555b950a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.279344 Sep 11 10:47:34.695348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 88/164] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:34 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:34.704184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] Creating event network-vif-plugged:3454460f-90bb-469f-8e1b-684905656adc for instance 0d30882d-5494-46e8-947a-7e3594aff794 on hv-cinder-85646 Sep 11 10:47:34.709511 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-ac7591b5-e107-4a37-9370-09b4e922adb9 req-a7b1a186-c7b4-48fb-8911-b5ff77472f9e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Sep 11 10:47:34.710342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 77/165] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:35.050079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:35.050680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:35.052517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=88 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:35.058315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.059032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.059479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.060487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.061085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.061508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.235865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.243580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3e741d09-d85e-4a07-9d34-c0bf1ac08458 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.197731 Sep 11 10:47:35.244137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 89/166] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:35 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:35.318173 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:35.318939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:35.325455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.325939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.326371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.327321 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.327803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.328345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.498230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.507101 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.508579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.509907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-92a69b10-6dab-4d2d-8a6b-f18aeac2da71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.204826 Sep 11 10:47:35.510462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 78/167] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:35 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:35.695670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:35.696290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:35.702420 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.702895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.703328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.704059 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.704487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.705587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.718084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:35.718926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:35.725594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.726292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.726786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.727498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:35.727945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:35.728360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:35.749095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:35.949571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.957260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f7813d28-9865-4d48-b472-1bd6495be6fe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.265467 Sep 11 10:47:35.957823 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 90/168] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:35 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:35.970081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:35.978386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6f7dea8c-a8c8-401c-9bbd-2810191b96b1 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.263956 Sep 11 10:47:35.979076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 79/169] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:35 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:36.269540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:36.270148 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:36.276244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.276720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.277237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:36.277936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.278507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.278925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:36.412849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:36.420358 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-eca52214-d45d-4703-8466-cef4aebc5f22 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.155384 Sep 11 10:47:36.420996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 91/170] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:36 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:36.537532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:36.538953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:36.545196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.545684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.546118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:36.546827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.547272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.547727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:36.902008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:36.910317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:36.911874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:36.913006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ab843291-9a76-43f8-8e8c-3de605801b17 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.380133 Sep 11 10:47:36.913562 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 80/171] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:36 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:36.980666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:36.981570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:36.988517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.989002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.989435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:36.990125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:36.990573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:36.991013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.004329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:37.005243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:37.011630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.012115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.012766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.013567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.014048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.014469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.199640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:37.212909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f2b69143-8bdd-42d9-9910-699cad8e2191 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.235205 Sep 11 10:47:37.214865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:37.222704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e05ddfb5-faed-4ac8-88b3-fdaf604ebb44 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.224369 Sep 11 10:47:37.223517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 81/172] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:36 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:37.229479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 92/173] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:36 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:37.445358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:37.446259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:37.452192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.452747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.453417 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.454180 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.454838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.455329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.590148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:37.598194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b30bddd6-30f0-430c-ba7a-7d414c7ff584 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.157628 Sep 11 10:47:37.598761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 82/174] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:37 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:37.937386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:37.938110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:37.944529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.945095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.945594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:37.946349 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:37.946806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:37.947229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.090468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.098809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.100353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.101544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-00cfd462-c9d5-4836-98e2-10b3d88f94bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.168023 Sep 11 10:47:38.102180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 93/175] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:37 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:38.236651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:38.237346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:38.243823 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.244307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.244771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.245464 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.245907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.246322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.246698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:38.247540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:38.253497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.254948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.255694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.256745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.257288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.257751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.527267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.545876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e1ef5e78-3426-4513-b90b-3ccfd17fa8be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.313647 Sep 11 10:47:38.547116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 83/176] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:38 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:38.557724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.565395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2cb30016-36bf-49cb-a2b2-c5fe49a46b09 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.323231 Sep 11 10:47:38.566126 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 94/177] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:38 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:38.622969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:38.623714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:38.630100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.630651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.631153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.631929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:38.632447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:38.633022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:38.793050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:38.800931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-55e20c98-834c-4809-8677-39341a76d237 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.181875 Sep 11 10:47:38.801488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 84/178] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:38 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:39.128454 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:39.129063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:39.134963 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.135474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.135913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.136595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.137071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.137490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.275260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.283540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.284976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.286086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bd624a7c-120b-47ba-ab3c-87f00b7a42f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.162619 Sep 11 10:47:39.286645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 95/179] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:39 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:39.570528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:39.571238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:39.577510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.578096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.578604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.579318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.579838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.580256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.588686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:39.589412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:39.596251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.596875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.597532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.598933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.599514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.600283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.805517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.809114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.814599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3e9d1759-7f47-42f8-989b-094f09d573cd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.247395 Sep 11 10:47:39.815252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 85/180] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:39 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:39.818966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-081e2b33-97cb-4e68-aa92-6412d0ebb9a7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.234053 Sep 11 10:47:39.819974 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 96/181] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:39 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:39.823929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:39.824556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:39.831787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.832264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.832689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.833365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:39.833810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:39.834222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:39.963299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:39.971097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-63969621-7a23-436a-b053-aa2667b47946 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.151179 Sep 11 10:47:39.971684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 86/182] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:39 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:40.315587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:40.316306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:40.322261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.322743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.323174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:40.323878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.324328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.324750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:40.467770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:40.476559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:40.478029 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:40.479144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0400a3f9-ad9f-43f9-bc4d-049ff7037ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.168044 Sep 11 10:47:40.479706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 97/183] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:40 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:40.837785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:40.838392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:40.841678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:40.842284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:40.845764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.846619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.847057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:40.847781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.848238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.848659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:40.848930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.849418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.849851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:40.850543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:40.851090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:40.851540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:41.046052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.050005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.053916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5458206a-479f-4c2f-a45a-4f632b94ed46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.219905 Sep 11 10:47:41.054484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 87/184] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:40 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:41.057646 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8754ee6c-aa1b-496a-b48f-f84fb304cbb7 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.219703 Sep 11 10:47:41.058195 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 98/185] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:40 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:41.058806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:41.059444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:41.073980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:41.074515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:41.074895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:41.075668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:41.076124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:41.076577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:41.208427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.216092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3897cd01-001b-4241-8b82-1d67fc65ed06 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.160609 Sep 11 10:47:41.216752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 88/186] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:41 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:41.504730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:41.505335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:41.512438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:41.512952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:41.513377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:41.514059 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:41.514512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:41.514924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:41.649907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.658555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.660043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:41.661136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-042222d2-4039-4c5a-b7db-238aa0fb02bd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.160319 Sep 11 10:47:41.661689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 99/187] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:41 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:42.083940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:42.084903 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:42.085351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:42.086053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:42.098530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.100634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.101169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.101874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.102530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.102980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.104037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.104442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.105516 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.106998 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.107547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.111585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.570044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.576541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.597757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-94205256-d9bd-4238-837a-1c291a656aab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.523546 Sep 11 10:47:42.603795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 89/188] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:42 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:42.609327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-957bdca0-f5e2-4785-b714-a6933d1465f9 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.532592 Sep 11 10:47:42.610088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 100/189] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:42 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:42.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:42.612999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:42.624363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.625064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.625686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.627169 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.628135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.628937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.685640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:42.686244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:42.695391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.695949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.696382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.697084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:42.700030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:42.700834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:42.833324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.841607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-69d9ea09-1e50-47f0-9e8b-4bcaac37986c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.236747 Sep 11 10:47:42.842622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 90/190] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:42 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:42.879783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.888631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.890052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:42.891154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8dbfc346-c4c1-4fd6-93cb-c232f6510232 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.209494 Sep 11 10:47:42.891759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 101/191] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:42 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:43.623203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:43.623847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:43.633712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.634193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.634628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.635336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.636069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.636237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.636764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:43.652985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:43.669982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.670603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.671272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.672230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.673099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.673879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.700335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:43.896942 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:43.900124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:43.906336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6c79177f-e21a-4cf7-8812-2f7792416cfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.286944 Sep 11 10:47:43.915683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 91/192] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:43 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:43.915859 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-003f2775-3952-40c1-b050-37fd5eb21b1d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.277832 Sep 11 10:47:43.915984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936f747a-7ced-4807-a2fe-72d35d9b9b20", "name": "network-vif-plugged", "status": "completed", "tag": "bac56ec2-e7e9-458f-954f-675340feff36"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:43.924310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 102/193] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:43 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:43.924459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.924459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.924645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.927128 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:43.927769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:43.935783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] Creating event network-vif-plugged:bac56ec2-e7e9-458f-954f-675340feff36 for instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 on hv-cinder-85646 Sep 11 10:47:43.937699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.939625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.940072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.940828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.941281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.941696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-464f1efe-6cac-49e2-a4cc-d80c7bcb411c req-57acdfc1-1885-4ac3-9872-5781e0bda3da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Sep 11 10:47:43.941800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.942278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 92/194] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:43.947303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:43.948005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:43.953845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.954370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.955027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:43.955893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:43.956342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:43.956758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:44.139924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:44.143295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:44.147711 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c0351216-31cb-4f9f-95f7-8ae2fc076b4f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.227098 Sep 11 10:47:44.148287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 103/195] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:43 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:44.151527 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:44.152966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:44.154056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-01567d22-fc6e-4655-9582-d808591813d2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.210670 Sep 11 10:47:44.154594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 93/196] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:43 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:44.931015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:44.932078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:44.932757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:44.933344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:44.934937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:44.939780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:44.939919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:44.940405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:44.940718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:44.940976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:44.941159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:44.941857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:44.941970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:44.942302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:44.942476 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:44.942714 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:44.943045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:45.133056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.137012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.140669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-50414c18-b70d-4ea4-b763-5cafac0f4a99 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.213944 Sep 11 10:47:45.141229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 104/197] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:44 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:45.144865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4d90c867-a23d-4662-968d-e9f7e15c0879 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.216660 Sep 11 10:47:45.145421 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 94/198] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:44 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:45.170888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:45.171591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:45.178499 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:45.178817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:45.178952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:45.179318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:45.179414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:45.180016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:45.180460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:45.180873 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:45.185218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:45.185707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:45.186140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:45.186826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:45.187278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:45.187733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:45.377719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.382492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.385242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-89994672-6318-494d-b305-61dc05c67e3c tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.218011 Sep 11 10:47:45.385804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 105/199] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:45 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:45.390780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.393139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:45.394340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b21287a4-a9ed-4493-bf7f-765b7e87cbcc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.219318 Sep 11 10:47:45.394963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 95/200] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:45 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:46.164115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:46.164702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:46.167638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:46.168254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:46.170795 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.171275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.171756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.172442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.172888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.173379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.174297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.174808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.175236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.175947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.176398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.176815 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.364887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.368723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.372406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:46.372898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ef4414d7-e89e-4e06-94ae-3cdccb80ff39 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.212606 Sep 11 10:47:46.373594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 106/201] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:46 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:46.378389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b87d7f7e-c437-4250-91f2-1dfbad13b980 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.214505 Sep 11 10:47:46.378951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 96/202] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:46 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:46.408557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:46.409150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:46.415054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.415493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.415928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.416601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.417048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.417461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.418867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:46.419496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:46.425693 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.426170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.426603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.427294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:46.427774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:46.428197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:46.613354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.616669 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.621146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2cc3c455-6345-49b6-b7a8-6600673298dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.216547 Sep 11 10:47:46.621708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 107/203] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:46 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:46.625183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.627190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:46.628316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6ec95036-e869-421c-ae3d-f30677ed1154 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.213236 Sep 11 10:47:46.628868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 97/204] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:46 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:47.396724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:47.397330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:47.403303 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.403815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.404249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.404351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:47.404929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:47.405034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.405375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.405794 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.411492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.411977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.412410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.413094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.413546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.413964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.594938 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.598297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.602782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4983903b-5fef-4253-b543-8c293cebf6bd tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.209833 Sep 11 10:47:47.603731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 108/205] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:47 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:47.606222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-94fa59f5-98b4-4667-92aa-443bea2b010a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.205597 Sep 11 10:47:47.607019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 98/206] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:47 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:47.644036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:47.644636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:47.650452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.650931 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.651371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.652152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.652601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.652839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:47.653018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.653443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:47.659340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.659856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.660290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.660977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:47.661427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:47.661880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:47.853516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.857291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.863002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5b0d7533-778a-4795-a6ee-7dc300d19fc6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.222783 Sep 11 10:47:47.863886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 109/207] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:47 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:47.870122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.871587 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:47.872745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f407a0b1-d424-4aaf-b25f-87ff321c2db3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.223767 Sep 11 10:47:47.873280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 99/208] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:47 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:48.627641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:48.628296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:48.629894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:48.630760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:48.634816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.639494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.639494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.639494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.639494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.639892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.640265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.640765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.641203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.642577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.643027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.643496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.834556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:48.839163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:48.842730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7838eaf5-f49b-44a9-8763-587df7332ba4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.219689 Sep 11 10:47:48.847554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-97dede28-0239-417c-aa26-66bacb5f0f72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.222276 Sep 11 10:47:48.848123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 100/209] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:48 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:48.849256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:48 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:48.885838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:48.886446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:48.894991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.895527 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.896114 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.896995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.904082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.904554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:48.904697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.905703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:48.912899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.913445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.914005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:48.914762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:48.915438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:48.916321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:49.115945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:49.119950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:49.125762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:49.128048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:49.128626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-93acb8c8-462c-4740-aa48-206b7caf0863 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.246503 Sep 11 10:47:49.129333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-dad0b5ca-9113-426e-8726-89469748d8e8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.229866 Sep 11 10:47:49.129680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:48 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:49.134629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 111/212] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:48 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:49.871988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:49.873665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:49.876016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:49.877452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:49.880988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:49.881579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:49.882180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:49.883044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:49.883482 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:49.883675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:49.884288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:49.884498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:49.884596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:49.885266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:49.885722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:49.886147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:50.124344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.132929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-521adf49-9c76-4eee-9eb5-36fbf209be6b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.266352 Sep 11 10:47:50.133801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 102/213] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:49 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:50.142552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.150922 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a2f0ad9c-97ac-4832-9a1a-f231cbb3fbc4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.282747 Sep 11 10:47:50.151498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 112/214] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:49 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:50.153781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:50.154473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:50.164742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:50.165367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:50.165868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:50.166637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:50.167163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:50.170822 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:50.171111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:50.171111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:50.175696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:50.176188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:50.176623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:50.177319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:50.177770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:50.178221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:50.385465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.388817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.395575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b2750106-6962-415e-a63a-c2ce360fdae0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.246993 Sep 11 10:47:50.396670 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 103/215] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:50 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:50.414851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.416557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:50.417729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6da74206-7053-43fe-89ab-000197d7d395 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.253037 Sep 11 10:47:50.418708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 113/216] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:50 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:51.166427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:51.167040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:51.175131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.175659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.176098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.176804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.177266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.180254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:51.180973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:51.181170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.194322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.194845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.198437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.199181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.199677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.200101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.806492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:51.819790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-48d043d9-c3f6-4cde-967d-a10d76013d0b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.661748 Sep 11 10:47:51.821608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 104/217] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:51 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:51.841361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:51.878841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:51.882098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:51.886912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5d35897a-509c-47d5-83dc-49a8638b5ca6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.709399 Sep 11 10:47:51.890189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 114/218] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:51 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:51.910221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d911c7c-f5ff-4c56-8cc9-e0a1362c306d", "name": "network-vif-plugged", "status": "completed", "tag": "f13730d1-f81a-478d-aedf-0d6d84958ecf"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:51.915379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.916546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.917206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.918056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.918987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.919649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.935281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.935792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.936216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.954698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] Creating event network-vif-plugged:f13730d1-f81a-478d-aedf-0d6d84958ecf for instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d on hv-cinder-85646 Sep 11 10:47:51.977190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-c94adb70-1d01-4c69-bc99-a91da4b53819 req-95200e76-d5e1-4f7a-8f20-cb04590eae6a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084510 Sep 11 10:47:51.977802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 115/219] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:51.983892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:51.984583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:51.997765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.998333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:51.998771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:51.999506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:51.999957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:52.000419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:52.270168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:52.283895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-21f0a3cf-aea3-4d39-b72c-857f88cbbf70 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.460635 Sep 11 10:47:52.284391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 105/220] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:51 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:52.296307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:52.307809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:52.309865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:52.310979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8bb158b6-61f8-4cc3-a6e6-52b8664dc539 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.331753 Sep 11 10:47:52.312015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 116/221] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:51 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:52.843882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:52.844522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:52.852229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:52.852703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:52.853344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:52.854031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:52.854695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:52.855112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:52.912101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:52.912997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:52.920354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:52.921073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:52.921844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:52.922843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:52.923557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:52.924199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:53.047208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.058123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-322b4348-e32d-4039-8072-698e87e9ea27 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.219011 Sep 11 10:47:53.059294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 106/222] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:52 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:53.104034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.112636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ce77dcec-8ae3-4445-bf41-7b49759e53a2 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.206318 Sep 11 10:47:53.113200 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 117/223] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:52 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:53.309535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:53.310791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:53.319897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:53.321736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:53.322709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:53.323750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:53.324684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:53.325448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:53.336658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:53.337276 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:53.346751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:53.347242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:53.347709 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:53.348405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:53.354247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:53.355133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:53.597627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.608333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.610197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.612487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-19ec2a86-0baf-45ce-b1dd-a839937df9fe tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.280188 Sep 11 10:47:53.613050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 118/224] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:53 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:53.646835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:53.653655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-de6e4d4b-5580-4935-b962-4a330d2e13bf tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.349400 Sep 11 10:47:53.671131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 107/225] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:53 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:54.081595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:54.082315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:54.088515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.088993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.089503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.090236 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.090668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.091174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.136042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:54.136698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:54.143003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.143450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.143989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.144690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.145147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.145626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.274306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.290431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:54.296080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c7b26d84-beaf-49e5-a10b-120f30d98d70 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.218620 Sep 11 10:47:54.296670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 119/226] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:54 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:54.311816 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.323628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8604ed00-6c33-407e-9dd6-6e626b1e3338 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.191000 Sep 11 10:47:54.324349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 108/227] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:54 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:54.639718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:54.640458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:54.646980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.647490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.647922 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.648749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.649239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.649661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.678489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:54.679099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:54.697377 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.700742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.701194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.701924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:54.702379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:54.702967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:54.846407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.856481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.858440 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.859897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f811a657-a98f-49a1-a491-a42bec37be7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.224197 Sep 11 10:47:54.861453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 120/228] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:54 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:54.897805 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:54.906051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1195bb9f-eea0-417b-91e7-238a4d408973 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.231852 Sep 11 10:47:54.906627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 109/229] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:54 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:55.323669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:55.324345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:55.331480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.331969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.332399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.333090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.333532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.333946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.346923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:55.347566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:55.353400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.353885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.354319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.355016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.355640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.356076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.528784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:55.535990 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:55.537352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f410e34b-ced5-4a54-8eb7-f5e1442b0744 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.217546 Sep 11 10:47:55.537965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 121/230] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:55 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:55.543772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-93a3898b-72d5-4475-95e0-be103b523f7e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.201535 Sep 11 10:47:55.544335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 110/231] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:55 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:55.889085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:55.889686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:55.896087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.896574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.897004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.897693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.898142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.898560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.929198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:55.929819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:55.935779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.936272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.936709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:55.937399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:55.937860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:55.938285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:56.080111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.088302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.089726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.090824 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-773dfeea-8647-4b64-ad99-f53b2f53f05f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.205549 Sep 11 10:47:56.091375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 122/232] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:55 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:56.105934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.114336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-00875974-e0e6-48d7-a67c-6d6e32864054 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.189034 Sep 11 10:47:56.114898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 111/233] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:55 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:56.561320 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:56.561991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:56.566544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:56.567089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:56.569050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:56.569537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:56.569978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:56.570703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:56.571164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:56.571627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:56.573182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:56.573665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:56.574099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:56.574773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:56.575228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:56.575674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:56.769801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.772706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:56.777510 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-85aba226-ef66-4e20-b6c8-44317c63b0cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.220222 Sep 11 10:47:56.778077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 123/234] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:56 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:56.780216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-529b5989-e330-4c48-974b-0885a9ab8568 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.218034 Sep 11 10:47:56.780764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 112/235] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:56 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:57.115588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:57.116093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:57.122858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.123508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.124063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.124776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.125395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.126013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.137967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:57.138569 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:57.144392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.144876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.145309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.146006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.146442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.146859 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.165341 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:57.327185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:57.331296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:57.335454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a0a613f8-0a54-46ac-ab1b-716ec818f2f2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.201257 Sep 11 10:47:57.336035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 113/236] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:57 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:57.340133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:57.341555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:57.342640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-918bc78f-32a3-416a-9098-9c07fef49536 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.230975 Sep 11 10:47:57.343173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 124/237] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:57 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:57.799734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:57.800350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:57.802874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:57.803573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:57.806683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.807178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.807655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.808353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.808865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.809324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.810713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.811194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.811811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:57.812856 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:57.813995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:57.814704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:58.176470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.182840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.184523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4514bf88-e4e9-4ea7-9ee5-1dd8b2e0e387 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.386083 Sep 11 10:47:58.185087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 125/238] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:57 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:58.190551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-96dae63d-4aae-4d76-b04b-474e04080dcb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.395047 Sep 11 10:47:58.191099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 114/239] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:57 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:58.360425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:58.361317 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:58.369518 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:58.370078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:58.370630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:58.378235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:58.378724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:58.379158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:58.379893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:58.380372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:58.381015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:58.381731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:58.382327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:58.383335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:58.383948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:58.384975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:58.578561 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.587776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.589217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.590391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a4cc17f9-af9e-41c4-afe2-2d7cc5caa8ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.225186 Sep 11 10:47:58.590873 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 115/240] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:58 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:47:58.593280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:58.601277 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-59727d1c-e295-4e6f-a27e-8ce7b9839439 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.246771 Sep 11 10:47:58.601838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 126/241] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:58 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:59.193754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "name": "network-vif-plugged", "status": "completed", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:47:59.204827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.205459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.205956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.207365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:59.208010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:59.215213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.216187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.216908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.218491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.219241 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.220871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.250880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] Creating event network-vif-plugged:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:47:59.257541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-f7eba5b1-3f71-435c-bfab-7a0da4e5cdf7 req-f0693bcf-4355-47f2-b5d1-7fbdfc1192cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067998 Sep 11 10:47:59.258066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 116/242] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:47:59.263567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:59.264254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:59.271752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.272267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.272695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.273469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.273918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.274332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.448291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.456425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c3dc40fb-dc0a-4ae6-9a33-e288a86099c6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.252911 Sep 11 10:47:59.474212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 127/243] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:59 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:47:59.475042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.483068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5c0ce89a-be0b-4437-bd8d-eb6b3c974f10 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.223727 Sep 11 10:47:59.483641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 117/244] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:59 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:47:59.614156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:59.614762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:59.620801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.621278 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.621711 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.622425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.622875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.623320 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.624908 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:47:59.625592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:47:59.631526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.632065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.632498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.633188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:47:59.633637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:47:59.634060 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:47:59.827934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.833216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.836819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.838271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:47:59.839557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f6782800-f627-409d-9764-0f5561d8db97 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.229237 Sep 11 10:47:59.840297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 128/245] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:47:59 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:47:59.842429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c1c6bdca-b0d5-4107-afdf-855334547b1f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.221724 Sep 11 10:47:59.843075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 118/246] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:47:59 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:00.481591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:00.482447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:00.488507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.488988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.489420 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.490113 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.490567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.490986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.506427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:00.507033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:00.513276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.513758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.514189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.514871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.515325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.515771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.713941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:00.717205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:00.722631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-40be4cdd-d718-4721-9a6e-c114866e0103 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1322 microversion: 2.1 time: 0.219988 Sep 11 10:48:00.723344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 119/247] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:00 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:00.726277 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a36f6156-ec0a-47e9-be17-79eb5f0e9b5d tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.248924 Sep 11 10:48:00.726891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 129/248] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:00 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:00.866273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:00.866481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:00.866784 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:00.867061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:00.872867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.873038 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.873347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.873478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.873806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.873928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.874477 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.874582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:00.874928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.875037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:00.875342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:00.875478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:01.086037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.089886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.096992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-84dd7a66-b99c-4568-be46-7837bce3a444 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1364 microversion: 2.1 time: 0.234251 Sep 11 10:48:01.098109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 130/249] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:00 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:01.100204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.102019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.103239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c34477f4-f904-4ed2-b5d2-cfe5c87ad29d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.240953 Sep 11 10:48:01.103891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 120/250] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:48:00 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:48:01.747536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:01.748129 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:01.748893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:01.749630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:01.755324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:01.755834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:01.756203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:01.756310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:01.756697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:01.756942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:01.757135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:01.757390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:01.757803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:01.757941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:01.758402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:01.758780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:01.975834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.980653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:01.984442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-723fc66b-189e-4e26-8c8f-7a6e97985fa2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1517 microversion: 2.1 time: 0.240969 Sep 11 10:48:01.986112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 131/251] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:01 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:01.999619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c6712508-b88b-4b67-a463-321458d966b6 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.254572 Sep 11 10:48:02.012418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 121/252] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:01 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:02.017993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:02.020697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:02.042523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.043375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.044185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.045014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.046078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.046837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.123609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:02.124854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:02.125628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'flavor' on Instance uuid 0d30882d-5494-46e8-947a-7e3594aff794 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:48:02.139348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.140112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.140576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.141278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.141733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.142195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.289675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-feffcf70-45e1-48e6-a217-4e60ca1a3b4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794/action" status: 200 len: 32 microversion: 2.1 time: 0.284990 Sep 11 10:48:02.294544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 132/253] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:48:02 2022] POST /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:48:02.296974 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:02.299837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:02.307801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.308327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.308724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.309454 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.309901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.310367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.353842 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:02.362867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-86fa95a1-ded6-43a0-9776-b05708569846 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1549 microversion: 2.1 time: 0.243033 Sep 11 10:48:02.364204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 122/254] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:02 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:02.372254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:02.373135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:02.379283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.379800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.380429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.381455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.382057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.382627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.537844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:02.549460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:02.554211 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:02.555632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-11d2b934-c7d8-446c-b140-a69e9fbbb327 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.263524 Sep 11 10:48:02.571447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 133/255] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:48:02 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:48:02.571447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:02.571447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:02.578157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.578157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.578157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.578157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:02.578611 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:02.578611 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:02.588265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:02.600889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:02.606219 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-01a5e769-d1c3-4372-a094-5cccb982f6fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.238672 Sep 11 10:48:02.621531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 123/256] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:02 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:02.682485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-78d3c284-fb51-46ac-87c2-2f0612900c9b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122355 Sep 11 10:48:02.683672 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 134/257] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 10:48:02 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:48:03.026005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:03.026850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:03.033183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.033683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.034114 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:03.035031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.036233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.036953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:03.586190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:03.587880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:03.593895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.594612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.595315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:03.596098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.596553 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.596987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:03.964752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:03.972665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9adf8191-6e43-4f78-8615-85258085fa86 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.950478 Sep 11 10:48:03.973241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 124/258] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:03 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:03.980409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:03.981020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:03.988475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.988965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.989407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:03.990105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:03.990557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:03.990979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:04.240400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:04.253568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:04.256181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:04.257982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a2ce8790-2739-4e42-9194-0b59d0c5cb1a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.675786 Sep 11 10:48:04.259813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 135/259] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:48:03 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:48:04.385529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:04.414521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fc9b3f76-5de5-43c8-81dc-c24c862432f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.440029 Sep 11 10:48:04.420387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 125/260] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:03 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:04.917768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936f747a-7ced-4807-a2fe-72d35d9b9b20", "tag": "bac56ec2-e7e9-458f-954f-675340feff36"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:04.932468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:04.932948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:04.933374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:04.945500 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] Creating event network-changed:bac56ec2-e7e9-458f-954f-675340feff36 for instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 on hv-cinder-85646 Sep 11 10:48:04.950730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-3804fe7a-ae31-4f54-bf69-51fd8fa2af38 req-cd2d569c-38b8-4b93-b7a5-78787914d3b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038849 Sep 11 10:48:04.951328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 136/261] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:48:04.996825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:04.998413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:05.005945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.006519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.007043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.008435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.009063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.010046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.164262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:05.172480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-99f67b12-6fde-4f68-aac7-6b317e8a8eca tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.179778 Sep 11 10:48:05.183488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 126/262] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:04 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:05.291538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:05.292825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:05.297050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=96 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:05.305548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.306053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.306536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.307484 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.308146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.308777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.442229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:05.443463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:05.451835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.452615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.453284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.454268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:05.454919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:05.455593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:05.840440 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:05.850046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:05.851747 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:05.853815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bfd24209-6e91-40dc-ae94-63186eac6740 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1406 microversion: 2.20 time: 0.570043 Sep 11 10:48:05.855364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 137/263] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:48:05 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:48:05.902827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:05.917073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8e12065c-fbba-4806-b4ad-9aa7c7bfb1fd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.481062 Sep 11 10:48:05.917937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 127/264] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:05 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:06.198127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:06.199082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:06.206815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.207306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.207772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:06.208468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.208914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.209327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:06.357792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:06.366277 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-07270319-d0ee-4e24-9558-59012d506438 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.173171 Sep 11 10:48:06.366903 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 138/265] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:06 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:06.880684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:06.881288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:06.887442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.887943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.888367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:06.889041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.889484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.889896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:06.944203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:06.944919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:06.951195 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.951805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.952240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:06.952919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:06.953362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:06.953849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:07.065131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:07.074627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:07.076182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:07.077333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-91ac1f02-6cee-4f8b-a728-e3252862ba7d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1598 microversion: 2.20 time: 0.200575 Sep 11 10:48:07.078082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 128/266] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:48:06 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1598 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:48:07.105569 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:07.107064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:07.115227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:07.115489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:07.115920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:07.116616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:07.117061 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:07.117479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:07.117572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:07.125478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ec319ce3-b62b-4a05-9d83-1439d06909c7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.185319 Sep 11 10:48:07.126048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 139/267] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:06 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:07.260217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d2b2a252-07d1-491e-a5b7-01482f595c0b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.159199 Sep 11 10:48:07.260852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 129/268] 10.222.0.15 () {60 vars in 1316 bytes} [Sun Sep 11 10:48:07 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:48:07.391033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:07.392658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:07.400288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:07.400781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:07.401210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:07.402190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:07.403085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:07.403542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:07.970907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:07.982971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a14c857e-50be-4cad-987c-7567bb42a0a0 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1314 microversion: 2.1 time: 0.596505 Sep 11 10:48:07.983942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 140/269] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:07 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:08.149249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:08.149931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:08.157358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:08.157931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:08.158373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:08.159073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:08.159558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:08.160179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:08.942852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:08.963702 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-15950999-8855-410f-ba1f-87c1b7d7a8c6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.819435 Sep 11 10:48:08.964280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 130/270] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:08 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:09.011906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:09.012849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:09.021162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:09.021645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:09.022076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:09.022767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:09.023212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:09.023671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:09.338743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:09.350326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a52ef805-ad2a-4cfe-a350-a171c1370ea3 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1500 microversion: 2.1 time: 0.344946 Sep 11 10:48:09.351022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 141/271] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:09 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1500 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:09.625588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:09.641453 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:09.641937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:09.642566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:09.649651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:09.660861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] Creating event network-changed:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:48:09.667228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-8e5b8067-7e5c-4d33-ab16-4abd955b8991 req-0e464c34-bacc-4ef6-a4e3-1004ad017609 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047874 Sep 11 10:48:09.668556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 131/272] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:48:09.989017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:09.989649 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:09.995997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:09.996435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:09.996875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:09.997578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:09.998028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:09.998453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:10.137362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:10.145911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2abb7e8d-f236-473c-9ac6-c957613b0eb4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.161434 Sep 11 10:48:10.146661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 142/273] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:09 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:11.169989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:11.170585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:11.176814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:11.177320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:11.177769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:11.178472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:11.178917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:11.179330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:11.311645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:11.320082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-82a13045-3b59-4461-af14-a53bca96f5d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.154897 Sep 11 10:48:11.320642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 132/274] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:11 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:12.343108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:12.343784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:12.351027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:12.351539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:12.351968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:12.352752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:12.353224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:12.353671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:12.482751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:12.490563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d4480b14-960b-4cc3-bc14-2b061e7dddfe tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.151231 Sep 11 10:48:12.491123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 143/275] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:12 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:13.513982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:13.514584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:13.521277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:13.521751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:13.522176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:13.522849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:13.523289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:13.523732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:13.649983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:13.657585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1958dce9-44da-4479-b298-70100f8ac6f8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.147804 Sep 11 10:48:13.658172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 133/276] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:13 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:14.680501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:14.681031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:14.687167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:14.687757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:14.688332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:14.689218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:14.689672 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:14.690093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:14.815815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:14.823337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1f34ee4c-e62f-4395-b3b2-ecf6b3ce6f3b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.146748 Sep 11 10:48:14.823933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 144/277] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:14 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:15.846217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:15.846818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:15.848846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=80 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:15.853958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:15.854438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:15.854869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:15.855585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:15.856033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:15.856451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:15.992046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:15.999690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b2e6c2b3-5499-4bad-b24f-f4a23ae936b2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.157347 Sep 11 10:48:16.000334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 134/278] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:15 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:17.023312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:17.023928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:17.030175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:17.030502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:17.030928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:17.031681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:17.032133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:17.032557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:17.091467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "786188ca-9110-4771-b237-195e1e814089"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:17.094542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:17.100874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:17.101365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:17.101796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:17.102519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:17.102970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:17.103392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:17.170862 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:17.179546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bc2e46d2-225b-4666-8b44-ca8fb21c9d7a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.160080 Sep 11 10:48:17.180199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 145/279] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:17 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:17.461644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-051f7b69-e62e-4b3b-baeb-2e8836ca0ecf tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "POST /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374217 Sep 11 10:48:17.465701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 135/280] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:48:17 2022] POST /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:48:18.203009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:18.204801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:18.211406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:18.211864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:18.212301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:18.212989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:18.213438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:18.213852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:18.346880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:18.354480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7d3e296b-f57c-4f19-97c1-c6d7c8d76270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.155388 Sep 11 10:48:18.355052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 146/281] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:18 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:19.378932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:19.379769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:19.386671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:19.387235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:19.387785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:19.388591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:19.389032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:19.389455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:19.601192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:19.615786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c9e5c798-01af-45c1-b86d-1271178113a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.241110 Sep 11 10:48:19.616381 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 136/282] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:19 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:20.641393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:20.641911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:20.648596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:20.649250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:20.649818 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:20.650516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:20.650978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:20.651407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:20.801256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:20.808985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-87022972-2a95-434c-a8e6-f87d89ef7183 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.171583 Sep 11 10:48:20.809692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 147/283] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:20 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:21.832892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:21.833496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:21.839793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:21.840268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:21.840700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:21.841377 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:21.841827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:21.842270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:21.974954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:21.982871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7169626a-9096-4c5e-b86f-24de95d48edd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.154571 Sep 11 10:48:21.983751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 137/284] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:21 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:23.006317 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:23.006995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:23.013774 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:23.014259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:23.014691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:23.015388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:23.016099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:23.017886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:23.146089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:23.153738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c9067900-a1fd-47f8-baf4-60a2d4007efa tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.151339 Sep 11 10:48:23.154289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 148/285] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:23 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:24.177737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:24.178367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:24.184922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:24.185396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:24.185826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:24.186604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:24.187090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:24.188160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:24.322431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:24.330596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3833dfdd-fb9c-4a6c-bf63-f31fae83dfbb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.156786 Sep 11 10:48:24.331154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 138/286] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:24 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:25.353287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:25.353885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:25.360917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:25.361392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:25.361818 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:25.362495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:25.362968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:25.363388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:25.490133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:25.497916 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-301d5dda-c245-428b-9755-f544d548dcdc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.148415 Sep 11 10:48:25.498475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 149/287] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:25 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:26.521747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:26.522351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:26.528648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:26.529126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:26.529558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:26.530238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:26.530690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:26.531653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:26.661235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:26.668817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7f99dab7-a34e-41dc-bef5-14286ff70e1c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.150975 Sep 11 10:48:26.669378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 139/288] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:26 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:27.692867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:27.693494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:27.699386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:27.699892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:27.700318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:27.701171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:27.701760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:27.702316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:27.850969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:27.858945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-12748734-6a90-439d-9f19-d88a745cbe4c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.169903 Sep 11 10:48:27.860585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 150/289] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:27 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:28.883335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:28.884079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:28.891476 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:28.891992 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:28.892430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:28.893275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:28.893603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:28.894035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:29.023216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:29.030726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-92befde3-6e38-46f9-b069-1fd942a40300 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.151158 Sep 11 10:48:29.031575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 140/290] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:28 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:30.053550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:30.054150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:30.060020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:30.060506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:30.060945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:30.061642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:30.062128 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:30.063196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:30.201547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:30.210035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bdeaa61e-87ba-447f-9aa3-ca7175f43cbc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.160981 Sep 11 10:48:30.210737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 151/291] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:30 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:31.233681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:31.234351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:31.240689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:31.241163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:31.241589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:31.242263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:31.242710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:31.243126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:31.374170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:31.383284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-39fa2c9e-b286-40fb-8285-d8ebe01f7dd5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.153748 Sep 11 10:48:31.383891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 141/292] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:31 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:32.406745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:32.407352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:32.413448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.414097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.414529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.415338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.415884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.416234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.420339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:32.482217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:32.482712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:32.490391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.490978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.491343 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.492109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.492495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.492931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.519408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:48:32.564288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:32.577352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f2d4c1f8-8946-4a5f-a3d7-5257f23b38e2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.173908 Sep 11 10:48:32.586561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 152/293] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:32 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:32.621881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9f855609-8960-4184-a52a-1dbc523ba12e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 204 len: 0 microversion: 2.1 time: 0.143382 Sep 11 10:48:32.622682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 142/294] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:48:32 2022] DELETE /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 10:48:32.630639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:32.631321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:32.637174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.637651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.638077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.638768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:32.639218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:32.639659 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:32.768665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:32.776925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b082f812-2e68-42fe-90ce-ed8c56785615 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1552 microversion: 2.1 time: 0.150101 Sep 11 10:48:32.777487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 153/295] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:32 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:33.601194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:33.601891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:33.608916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:33.609409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:33.609946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:33.610640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:33.611094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:33.611544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:33.744395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:33.753596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-61f57f8a-00c5-474c-be36-f2e97b0224d0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.156419 Sep 11 10:48:33.754401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 143/296] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:33 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:33.801455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:33.802061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:33.808405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:33.809108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:33.809552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:33.810256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:33.810715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:33.811142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:33.947389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:33.956861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4006ca0f-9339-4e11-b7ac-1d0ba3c673db tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1552 microversion: 2.1 time: 0.160298 Sep 11 10:48:33.957437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 154/297] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:33 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:34.779540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:34.780329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:34.787616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:34.788106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:34.791344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:34.791344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:34.791344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:34.791344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:34.923445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:34.931137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d3383ea5-afb1-4698-a267-b6b00f065a9a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.157061 Sep 11 10:48:34.931738 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 144/298] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:34 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:34.980214 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:34.980955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:34.987919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:34.988404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:34.988836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:34.989522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:34.989971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:34.990390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:35.125012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:35.133726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-87d83db9-fded-4422-946f-4d44c49848ad tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1552 microversion: 2.1 time: 0.157280 Sep 11 10:48:35.134360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 155/299] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:34 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:35.954371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:35.954980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:35.961378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:35.962103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:35.962304 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:35.963004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:35.963485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:35.963916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:35.982636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:36.096142 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:36.103709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-16b1c2cd-d450-4c5e-a281-db69d2267a4a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.153568 Sep 11 10:48:36.104269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 145/300] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:35 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:36.157565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:36.158215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:36.160011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=38 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:36.165798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:36.166282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:36.166708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:36.167733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:36.168121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:36.168433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:36.551464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:36.559910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3c438d28-1afe-4ad3-a534-a25544f72df4 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1552 microversion: 2.1 time: 0.406799 Sep 11 10:48:36.560504 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 156/301] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:36 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1552 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:37.047048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d911c7c-f5ff-4c56-8cc9-e0a1362c306d", "name": "network-vif-deleted", "tag": "f13730d1-f81a-478d-aedf-0d6d84958ecf"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:37.057698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:37.058193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:37.058616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:37.070880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] Creating event network-vif-deleted:f13730d1-f81a-478d-aedf-0d6d84958ecf for instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d on hv-cinder-85646 Sep 11 10:48:37.076062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-d6fa3437-366d-4d96-9b8c-df302e78ae35 req-4dcbde1f-762b-4bd6-8b40-4f037db4ce82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032778 Sep 11 10:48:37.076640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 146/302] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:48:37.130468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:37.131074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:37.136971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:37.137445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:37.138085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:37.138771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:37.139216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:37.139652 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:37.277449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:37.286064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-231bb1c9-d595-4b58-8b49-3ad5315f35d2 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.160091 Sep 11 10:48:37.286635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 157/303] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:37 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:37.584010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:37.584841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:37.591191 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:37.591703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:37.592127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:37.592811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:37.593912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:37.594334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:37.655914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:37.663983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ab658d03-a3a8-43b2-beb9-acd798f8be9b tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1345 microversion: 2.1 time: 0.084420 Sep 11 10:48:37.664536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 147/304] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:37 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:38.309786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:38.310618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:38.316920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:38.317402 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:38.317829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:38.318514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:38.318957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:38.319372 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:38.448707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:38.457164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9b276761-5cbd-46e4-ae34-c82f5cdee222 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.151818 Sep 11 10:48:38.457727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 158/305] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:38 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:38.686728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:38.688397 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:38.694614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:38.695130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:38.695600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:38.696291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:38.696740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:38.697161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:38.758122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:38.767328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f1bd421e-df34-4e84-ba7b-0fbe896a6906 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1345 microversion: 2.1 time: 0.084325 Sep 11 10:48:38.767936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 148/306] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:38 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:39.480585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:39.481282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:39.488159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:39.488641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:39.489072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:39.489759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:39.490213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:39.490631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:39.617159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:39.625075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-168ca962-43c8-43ed-91e6-1c4013169a85 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.148018 Sep 11 10:48:39.625791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 159/307] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:39 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:39.789995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:39.790610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:39.796999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:39.797493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:39.797937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:39.798649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:39.799085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:39.799543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:39.832113 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:39.832608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:39.833045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:39.833510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lazy-loading 'fault' on Instance uuid 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:48:39.881507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9f58a33d1449099bd39f8d09f9f0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e895a982b34e958af26f5287567949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:39.891220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-39f99eba-60d0-49fe-bcfe-1a694aa5e1aa tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 200 len: 1350 microversion: 2.1 time: 0.104039 Sep 11 10:48:39.891974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 149/308] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:39 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:40.648375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:40.648980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:40.654923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:40.655404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:40.656073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:40.656768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:40.657214 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:40.657634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:40.788551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:40.796151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0b33d674-1301-4d41-8fec-c9b88a288294 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.151631 Sep 11 10:48:40.797419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 160/309] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:40 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:40.914030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:40.914642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:40.924413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:40.924914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:40.925349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:40.926050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:40.926506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:40.926934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:40.940840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] HTTP exception thrown: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Request method failure captured: Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d HTTP/1.1 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyclrvmayG2B7j7_UswkbdVewWeVyrDT0rcZC-MhofnDCh1GVXnTXInIqwR7Njhm1u7WEfq4ufsnl6PF2mg8m0JApLiUXlnBT3Lqw3ex53Sr8q3Hp2yzrtl7kqFAvlzl__GGqGHPcZd1_6dPfJLUBNzNpt9PIKfYS-T2_znX3sYLfA Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:48:40.945426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_74e895a982b34e958af26f5287567949", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/74e895a982b34e958af26f5287567949"}]}] Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: ea9f58a33d1449099bd39f8d09f9f0cd Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:40.946917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '4d911c7c-f5ff-4c56-8cc9-e0a1362c306d'} Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:48:40.947800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:40.949166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:40.950422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Returning 404 to user: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:48:40.950422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3a0d0cfb-bade-49d5-b065-925b1916d29e tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 404 len: 111 microversion: 2.1 time: 0.036698 Sep 11 10:48:40.950422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 150/310] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:40 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:41.064361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:41.066642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:41.072517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:41.072997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:41.073450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:41.074113 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:41.074564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:41.074981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:41.087245 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] HTTP exception thrown: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Request method failure captured: Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d/os-volume_attachments HTTP/1.1 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyclrvmayG2B7j7_UswkbdVewWeVyrDT0rcZC-MhofnDCh1GVXnTXInIqwR7Njhm1u7WEfq4ufsnl6PF2mg8m0JApLiUXlnBT3Lqw3ex53Sr8q3Hp2yzrtl7kqFAvlzl__GGqGHPcZd1_6dPfJLUBNzNpt9PIKfYS-T2_znX3sYLfA Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:48:41.091209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_74e895a982b34e958af26f5287567949", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/74e895a982b34e958af26f5287567949"}]}] Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: ea9f58a33d1449099bd39f8d09f9f0cd Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:41.092627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'server_id': '4d911c7c-f5ff-4c56-8cc9-e0a1362c306d'} Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:48:41.094057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:41.095473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:41.096901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Returning 404 to user: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:48:41.096901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-467047c8-5c4d-4a12-9030-162019d70e24 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032349 Sep 11 10:48:41.096901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 161/311] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:48:41 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:41.819245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:41.819951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:41.826115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:41.826541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:41.827153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:41.828605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:41.829276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:41.829686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:41.967123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:41.975401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ee5c0a55-5364-4145-9505-507c90177848 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.160116 Sep 11 10:48:41.975994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 151/312] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:41 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:42.312176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:42.312874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:42.319397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:42.319936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:42.320376 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:42.321069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:42.321520 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:42.321944 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:42.336011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] HTTP exception thrown: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Request method failure captured: Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d HTTP/1.1 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyclrvmayG2B7j7_UswkbdVewWeVyrDT0rcZC-MhofnDCh1GVXnTXInIqwR7Njhm1u7WEfq4ufsnl6PF2mg8m0JApLiUXlnBT3Lqw3ex53Sr8q3Hp2yzrtl7kqFAvlzl__GGqGHPcZd1_6dPfJLUBNzNpt9PIKfYS-T2_znX3sYLfA Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:48:42.338136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_74e895a982b34e958af26f5287567949", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/74e895a982b34e958af26f5287567949"}]}] Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: ea9f58a33d1449099bd39f8d09f9f0cd Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.339673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '4d911c7c-f5ff-4c56-8cc9-e0a1362c306d'} Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:48:42.340384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.341745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.343636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Returning 404 to user: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:48:42.343636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-65794d85-8dd7-4a3c-9001-b5e625dafa57 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 404 len: 111 microversion: 2.1 time: 0.031539 Sep 11 10:48:42.343636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 162/313] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:48:42 2022] DELETE /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:42.348645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:42.349384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] [instance: 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:42.355595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:42.356096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:42.356543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:42.357500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:42.358125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:42.358748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:42.373103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] HTTP exception thrown: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Request method failure captured: Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d HTTP/1.1 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyclrvmayG2B7j7_UswkbdVewWeVyrDT0rcZC-MhofnDCh1GVXnTXInIqwR7Njhm1u7WEfq4ufsnl6PF2mg8m0JApLiUXlnBT3Lqw3ex53Sr8q3Hp2yzrtl7kqFAvlzl__GGqGHPcZd1_6dPfJLUBNzNpt9PIKfYS-T2_znX3sYLfA Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:48:42.374736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/74e895a982b34e958af26f5287567949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_74e895a982b34e958af26f5287567949", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/74e895a982b34e958af26f5287567949"}]}] Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 74e895a982b34e958af26f5287567949 Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-DeleteServersTestJSON-241648386 Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: ea9f58a33d1449099bd39f8d09f9f0cd Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-DeleteServersTestJSON-241648386-project Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.377729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '4d911c7c-f5ff-4c56-8cc9-e0a1362c306d'} Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:48:42.378694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. Sep 11 10:48:42.380333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:48:42.381481 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] Returning 404 to user: Instance 4d911c7c-f5ff-4c56-8cc9-e0a1362c306d could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:48:42.381481 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-93b89bdf-7560-43ed-aa19-e2c41a863b52 tempest-DeleteServersTestJSON-241648386 tempest-DeleteServersTestJSON-241648386-project] 10.222.0.15 "GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d" status: 404 len: 111 microversion: 2.1 time: 0.031415 Sep 11 10:48:42.381481 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 152/314] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:42 2022] GET /compute/v2.1/servers/4d911c7c-f5ff-4c56-8cc9-e0a1362c306d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:48:42.999122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:43.000646 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:43.006776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:43.007260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:43.007742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:43.008405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:43.008911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:43.009328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:43.283884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:43.291774 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6501cc35-8422-40a0-bd54-ca98fd4c1de9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.296438 Sep 11 10:48:43.292367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 163/315] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:42 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:44.323947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:44.326721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:44.338547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:44.341020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:44.343679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:44.346525 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:44.349589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:44.350112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:44.626190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:44.638677 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-25f65da6-6040-4423-8808-356fec071a9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.322377 Sep 11 10:48:44.641352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 153/316] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:44 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:45.664256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:45.664867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:45.678420 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:45.679117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:45.679748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:45.681198 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:45.682650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:45.683939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:46.107956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:46.116791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-80ccfc20-1690-4988-a92d-3ec41ffc9264 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.456233 Sep 11 10:48:46.129452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 164/317] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:45 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:47.146121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:47.146657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:47.151276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:47.155144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:47.156450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:47.156883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:47.158037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:47.158646 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:47.159149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:47.325932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:47.337261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4af27d4f-e0da-455f-87c9-99aff8702824 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.200557 Sep 11 10:48:47.338771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 154/318] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:47 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:48.362312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:48.363097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:48.370035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:48.370465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:48.371038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:48.371908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:48.372655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:48.373154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:48.523874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:48.533235 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6518dee5-0bef-4cc4-bdfe-79a6ae143b9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.176091 Sep 11 10:48:48.535505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 165/319] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:48 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:49.559212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:49.561131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:49.587948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:49.590254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:49.590893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:49.592675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:49.593749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:49.595166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:49.862111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:49.871639 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c6de0da2-2491-4ab7-bdd9-f6c2aa9e89e1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.316329 Sep 11 10:48:49.872229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 155/320] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:49 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:50.898049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:50.898654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:50.904517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:50.905026 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:50.906123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:50.906815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:50.907302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:50.908125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:51.087982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:51.096536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-710c0f8b-b3ca-464c-a4de-37f4adac11f5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1523 microversion: 2.1 time: 0.202353 Sep 11 10:48:51.097180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 166/321] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:50 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:52.120474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:52.121087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:52.131267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:52.131267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:52.131267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:52.131267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:52.131650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:52.131650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:52.276969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:52.285854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2e92d36d-4615-45ae-bff3-9320a4089845 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1503 microversion: 2.1 time: 0.169188 Sep 11 10:48:52.286426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 156/322] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:52 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:52.308738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:52.309345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:52.316920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:52.317403 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:52.317838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:52.318532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:52.318980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:52.319400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:52.475843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:52.485508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4cc6f28a-a385-421e-86ed-86d42d1087e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1516 microversion: 2.1 time: 0.180328 Sep 11 10:48:52.486192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 167/323] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:52 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:48:52.833470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-519005624", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "networks": [{"uuid": "519cfee4-5d30-4dcb-92fd-c824f6b2acef"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:48:53.028521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] validate_networks() for [('519cfee4-5d30-4dcb-92fd-c824f6b2acef', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:48:53.399033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:48:53.399665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:48:53.399934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:48:53.400349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:48:53.400757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:48:53.410330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:53.410930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:53.411536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:53.412558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:53.413102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:53.413817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:53.431389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Getting quotas for project 6e5993a0a4964d7597bf4e2e8f252171. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:48:53.435761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Getting quotas for user 30f5e5a2ce8749d692600f1d2ab4fdb9 and project 6e5993a0a4964d7597bf4e2e8f252171. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:48:53.447757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:48:53.450042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:48:53.498508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-54c0bf7f-bbae-40cd-9864-b97a875c5ddb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668778 Sep 11 10:48:53.505360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 157/324] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:48:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 10:48:53.510377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-afb6b275-7b77-439d-9711-8a910e1c7cfa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:53.511011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-afb6b275-7b77-439d-9711-8a910e1c7cfa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:53.566833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-afb6b275-7b77-439d-9711-8a910e1c7cfa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:53.576696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-afb6b275-7b77-439d-9711-8a910e1c7cfa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1213 microversion: 2.1 time: 0.069917 Sep 11 10:48:53.577919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 168/325] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:53 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:54.600750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:54.601359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:54.607545 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:54.608028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:54.609234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:54.609988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:54.610449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:54.610872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:54.687120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:54.695008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d3da2ca7-48fd-4dec-ade7-ec42562f78dd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1209 microversion: 2.1 time: 0.098499 Sep 11 10:48:54.695610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 158/326] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:54 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:55.719399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:55.720033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:55.726177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:55.726654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:55.727086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:55.727814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:55.728266 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:55.728688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:55.792314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:55.800585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c9d086ba-1d80-4abe-bb87-0a2f74650874 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1209 microversion: 2.1 time: 0.084975 Sep 11 10:48:55.801137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 169/327] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:55 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:56.823966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:56.824650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:56.832307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:56.832941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:56.833219 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:56.833909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:56.834358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:56.834774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:56.899048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:56.906885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7fea3ffc-650b-4972-a848-c191b89461f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1209 microversion: 2.1 time: 0.086655 Sep 11 10:48:56.907478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 159/328] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:56 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:57.929798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:57.930393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:57.936347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:57.937353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:57.937780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:57.938451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:57.938901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:57.939313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:58.002757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:58.010326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0f4fa3dc-17a2-4cf9-8ddb-9cc442af873a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1265 microversion: 2.1 time: 0.084252 Sep 11 10:48:58.010938 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 170/329] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:57 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:48:59.037921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:48:59.038778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:48:59.056054 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:59.057622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:59.058247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:59.059143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:48:59.059913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:48:59.060605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:48:59.232711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:48:59.252041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-09bb533c-5681-4f34-9ef5-d01c9168a579 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.222430 Sep 11 10:48:59.253106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 160/330] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:48:59 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:00.276886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:00.277490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:00.284434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:00.284847 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:00.285277 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:00.285966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:00.286412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:00.286829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:00.290888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:00.417149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:00.425692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-20309578-0381-4f4b-910f-211b8714f451 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.152633 Sep 11 10:49:00.426245 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 171/331] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:00 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:01.448328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:01.448963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:01.455335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:01.455839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:01.456270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:01.456957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:01.457410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:01.457834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:01.583758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:01.591239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-332e02fd-8d4d-4837-b7b8-c736bc1dc258 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.146743 Sep 11 10:49:01.591808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 161/332] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:01 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:02.614724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:02.615252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:02.621146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:02.621622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:02.622049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:02.622724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:02.623191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:02.624112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:02.829896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:02.837530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-09bf56bb-4f10-4684-a1d0-79a02aa51d0f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.226780 Sep 11 10:49:02.838083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 172/333] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:02 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:03.402573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8e81a1-8b0f-460e-ba32-85247c9fe1c9", "tag": "c71124f1-c5ac-4ce4-a93d-a2197392f192"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:03.419324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:03.419767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:03.420203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:03.424898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:03.432979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] Creating event network-changed:c71124f1-c5ac-4ce4-a93d-a2197392f192 for instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 on hv-cinder-85646 Sep 11 10:49:03.438633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-dccc689f-3243-4bb3-a505-26e4ad445131 req-949316b9-795e-4c9d-bdac-500cb5d52866 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040133 Sep 11 10:49:03.439387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 162/334] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:03.860612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:03.861222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:03.863035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:03.868492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:03.868976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:03.869434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:03.870119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:03.870576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:03.870995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:04.011670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:04.019907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5138893b-b2cc-43b5-b30b-ae9c63431e54 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.163473 Sep 11 10:49:04.020459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 173/335] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:03 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:04.542141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:04.547798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:04.550115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:04.556446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:04.556932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:04.557378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:04.558070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:04.558522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:04.558947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:04.583941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'flavor' on Instance uuid fc097091-fee3-409f-89ea-48aa3782c5f5 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:49:04.661510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:04.690641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f73eb49b-363e-458e-be60-8a5efc62d545 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/action" status: 200 len: 32 microversion: 2.1 time: 0.149138 Sep 11 10:49:04.691261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 163/336] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:49:04 2022] POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:49:04.700664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:04.701272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:04.707310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:04.707836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:04.708272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:04.708959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:04.709415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:04.709838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:04.839030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:04.847488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-55ea7f11-24aa-47c3-80f7-8e91c8d991e3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.150598 Sep 11 10:49:04.848040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 174/337] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:04 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:05.045125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:05.046799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:05.053128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:05.053606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:05.054035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:05.054726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:05.055179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:05.055623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:05.186745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:05.194799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-052418e9-8df9-478b-acf8-85d6725abecb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.153922 Sep 11 10:49:05.195362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 164/338] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:05 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:05.871345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:05.871905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:05.878401 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:05.878886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:05.879322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:05.880035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:05.880491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:05.880914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:06.008381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:06.016111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0719ad3c-3774-43ea-844d-4ca908e4a828 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.148743 Sep 11 10:49:06.016664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 175/339] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:05 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:06.218052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:06.218657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:06.225002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:06.225478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:06.225910 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:06.226597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:06.227050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:06.227502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:06.359817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:06.367411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-75f4aa61-c3d5-4dc6-91ce-efd9f18d5a9e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.153277 Sep 11 10:49:06.367978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 165/340] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:06 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:07.037996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:07.038681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:07.040552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=42 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:07.046257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:07.046745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:07.047184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:07.047912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:07.048383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:07.048793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:07.174673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:07.182395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bfffc592-2b47-4c42-8589-e6f7af17d87d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.148218 Sep 11 10:49:07.183070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 176/341] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:07 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:07.390754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:07.391399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:07.397706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:07.398194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:07.398629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:07.399317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:07.399795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:07.400216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:07.528815 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:07.536601 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-eb81ca3b-fa53-4778-877f-a7e672289af1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.150405 Sep 11 10:49:07.537158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 166/342] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:07 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:08.207515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:08.208054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:08.213924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:08.214400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:08.214829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:08.215529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:08.215975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:08.216393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:08.348636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:08.356226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-00f8e264-ec8d-433a-8427-c5446a94b77a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.152643 Sep 11 10:49:08.356781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 177/343] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:08 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:08.560047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:08.560659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:08.567634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:08.568122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:08.568677 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:08.569444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:08.569899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:08.570323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:08.699530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:08.708387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1a0cf56d-6bc6-4642-a279-cf12b8c4f12f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.152119 Sep 11 10:49:08.708956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 167/344] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:08 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:09.381912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:09.382528 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:09.388606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:09.389114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:09.389674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:09.390822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:09.391373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:09.391856 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:09.555127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:09.564424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8165e2a3-c2be-4a8b-98d0-7afc83f84864 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.188303 Sep 11 10:49:09.565027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 178/345] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:09 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:09.733365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:09.733976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:09.741096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:09.741612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:09.742220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:09.742922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:09.743376 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:09.743829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:09.900241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:09.909659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0824a529-5a14-4b13-ab6f-1ae9046fd884 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.182008 Sep 11 10:49:09.910969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 168/346] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:09 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:10.588552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:10.589159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:10.596286 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:10.596884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:10.599283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:10.600064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:10.600530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:10.600961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:10.730275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:10.738168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-69a5db90-e5d1-408c-ad56-1dce353a686c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.153476 Sep 11 10:49:10.738719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 179/347] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:10 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:10.939618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:10.940222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:10.946827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:10.947647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:10.948077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:10.948806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:10.949257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:10.949680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:11.092112 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:11.100188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0fb9b9bf-110e-4a93-98ba-e71e84ad6603 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.165164 Sep 11 10:49:11.100747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 169/348] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:10 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:11.767709 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:11.768316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:11.774303 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:11.774712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:11.775146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:11.775867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:11.776322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:11.776740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:12.083345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:12.091145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7e466b29-00cc-4083-a1cd-076990b15961 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.333926 Sep 11 10:49:12.091749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 180/349] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:11 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:12.123228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:12.124534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:12.131206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:12.131799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:12.132304 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:12.133071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:12.133595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:12.134087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:12.418364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:12.426404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-64c55570-80e0-464e-b3f3-0d8c3296a00c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.306942 Sep 11 10:49:12.426962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 170/350] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:12 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:13.113815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:13.114423 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:13.120343 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:13.120821 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:13.121251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:13.121927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:13.122373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:13.122793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:13.246665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:13.254787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-24b154ea-d49c-49de-a416-19618f7936be tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.144731 Sep 11 10:49:13.255337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 181/351] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:13 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:13.448739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:13.449343 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:13.456438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:13.456916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:13.457346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:13.458023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:13.458470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:13.458888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:13.586807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:13.595036 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-05da6b41-9c37-4697-8ff5-48b74100c388 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.150178 Sep 11 10:49:13.595621 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 171/352] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:13 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:14.278171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:14.278785 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:14.284906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:14.285395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:14.285827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:14.286521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:14.286973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:14.287395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:14.414203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:14.422328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3b1b37b1-d2d0-4a1f-a2a6-10d2ea98c652 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.148039 Sep 11 10:49:14.422878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 182/353] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:14 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:14.618249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:14.618829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:14.625273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:14.625754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:14.626197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:14.626889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:14.627341 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:14.627798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:14.753850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:14.761517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-08d6bdfd-8ef9-4903-bb4e-d94f15686f82 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.147243 Sep 11 10:49:14.762314 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 172/354] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:14 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:15.445936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:15.446551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:15.453309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:15.453778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:15.454208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:15.454878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:15.455324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:15.455770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:15.583710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:15.591472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4803ea2e-d9ca-42e4-839c-1eff01832985 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.149358 Sep 11 10:49:15.592040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 183/355] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:15 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:15.785781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:15.786426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:15.792757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:15.793238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:15.793671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:15.794359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:15.794811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:15.795767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:15.926051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:15.933936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-85384e26-e358-4b26-85d9-364565f156a7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.151995 Sep 11 10:49:15.934500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 173/356] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:15 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:16.614034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:16.614638 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:16.620577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:16.621061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:16.621491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:16.622176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:16.622625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:16.623048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:16.752558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:16.760166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fee5201d-8bcf-47a7-8e0b-f22db1357eb7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.149940 Sep 11 10:49:16.760719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 184/357] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:16 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:16.957727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:16.958363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:16.964756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:16.965231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:16.965656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:16.966332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:16.966778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:16.967969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:17.094567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:17.102275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fdfcc2ee-ff20-40b0-b9b9-42a2fd37be2c tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.148286 Sep 11 10:49:17.102871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 174/358] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:16 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:17.782899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:17.783527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:17.789439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:17.789922 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:17.790356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:17.791047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:17.791517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:17.791941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:17.917730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:17.925841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-071b0dc0-3d91-42a2-9da4-4ec2ac462248 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.146898 Sep 11 10:49:17.926392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 185/359] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:17 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:18.126862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:18.127575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:18.129777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:18.135009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:18.135532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:18.135975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:18.136665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:18.137127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:18.137554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:18.269219 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:18.277051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-97533743-bbe1-4ba0-b19d-1b5bb68913da tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.154969 Sep 11 10:49:18.277618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 175/360] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:18 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:18.949009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:18.949617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:18.956058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:18.956538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:18.956972 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:18.957657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:18.958107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:18.958524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:19.087067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:19.095182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-97ca3cb5-d9c8-401d-8699-340bc1537f17 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.150043 Sep 11 10:49:19.095771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 186/361] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:18 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:19.300794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:19.301410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:19.308551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:19.309046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:19.309490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:19.310192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:19.311195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:19.311750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:19.443925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:19.451533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-245dd921-02f2-48a4-973e-789bc545c69a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.154507 Sep 11 10:49:19.452124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 176/362] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:19 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:20.117981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:20.118616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:20.124559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:20.125177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:20.125479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:20.126161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:20.126610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:20.127029 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:20.253965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:20.257307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:20.262495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7bbc9885-1971-4031-886d-444163502c8c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.148429 Sep 11 10:49:20.263058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 187/363] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:20 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:20.474080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:20.474687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:20.482625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:20.483124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:20.483806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:20.484578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:20.485031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:20.485457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:20.615802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:20.624127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8f286d92-0102-4cd8-aff2-1ba95d2d7426 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.153157 Sep 11 10:49:20.624868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 177/364] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:20 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:20.787482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8e81a1-8b0f-460e-ba32-85247c9fe1c9", "name": "network-vif-plugged", "status": "completed", "tag": "c71124f1-c5ac-4ce4-a93d-a2197392f192"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:20.797093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:20.797568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:20.797994 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:20.809194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] Creating event network-vif-plugged:c71124f1-c5ac-4ce4-a93d-a2197392f192 for instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 on hv-cinder-85646 Sep 11 10:49:20.814936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-0f3f6da7-c864-48e1-b97a-5d3803d69e7a req-ba3688a6-90d7-49c2-a9ba-e09982532369 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031214 Sep 11 10:49:20.815632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 188/365] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:21.286746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:21.287464 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:21.293169 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:21.293647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:21.294075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:21.294763 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:21.295456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:21.296301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:21.423187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:21.430768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e2de6d19-fc92-4980-b47d-cc1c0bfe070e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.148000 Sep 11 10:49:21.431319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 178/366] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:21 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:21.648737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:21.649389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:21.655530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:21.656009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:21.656460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:21.657136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:21.657583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:21.658001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:21.788488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:21.796537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-07baa3e3-8f33-47cb-9738-a80f5c8fd478 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.152042 Sep 11 10:49:21.797293 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 189/367] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:21 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:22.454912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:22.455594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:22.462196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:22.462681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:22.463116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:22.463844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:22.464307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:22.464730 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:22.601004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:22.604370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:22.610404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ab04e061-f01a-43a0-8ab8-ff4de109f31e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.160100 Sep 11 10:49:22.611031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 179/368] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:22 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:22.820805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:22.821409 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:22.827338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:22.827854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:22.828296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:22.828986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:22.829442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:22.829866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:22.961536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:22.970000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9b09928c-487f-41a7-a866-0939ff15aeaf tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.153390 Sep 11 10:49:22.970549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 190/369] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:22 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:23.636705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:23.637321 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:23.646445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:23.646945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:23.647385 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:23.650596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:23.652057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:23.652602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:23.862904 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:23.872342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-157082bb-9844-4602-b446-9aa7ef68a9ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.241081 Sep 11 10:49:23.881261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 180/370] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:23 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:23.994500 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:23.995278 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:24.002613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:24.003094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:24.003555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:24.004243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:24.004691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:24.005104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:24.142588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:24.151451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-80009ac8-130f-42be-b9c2-6f0ada1fe9dc tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1313 microversion: 2.1 time: 0.160811 Sep 11 10:49:24.152041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 191/371] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:23 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:24.895871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:24.896478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:24.903387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:24.903888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:24.904906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:24.905894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:24.906349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:24.906836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:25.087100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:25.096312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-04a8b734-f6eb-4c8e-8331-8ff2331ce119 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.204254 Sep 11 10:49:25.096879 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 181/372] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:24 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:25.177925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:25.178454 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:25.184443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:25.184924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:25.185359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:25.186179 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:25.186639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:25.187061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:25.321402 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:25.329419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3e23bb28-d0b9-41ab-bbf0-55047293f822 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1497 microversion: 2.1 time: 0.156603 Sep 11 10:49:25.329973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 192/373] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:25 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:26.120541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:26.121151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:26.128626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:26.129118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:26.129546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:26.144403 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:26.144883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:26.145319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:26.283334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:26.291623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4059659b-b303-4bed-be8b-c65d27c0afc7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.174864 Sep 11 10:49:26.292198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 182/374] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:26 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:27.317737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:27.318366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:27.324257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:27.324747 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:27.325156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:27.325831 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:27.326921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:27.327335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:27.466765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:27.474582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f2635979-5480-4c1e-8b25-b4565a24275d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.160912 Sep 11 10:49:27.475131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 193/375] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:27 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:28.497197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:28.497804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:28.504776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:28.505262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:28.505692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:28.506387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:28.506837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:28.507257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:28.646934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:28.655375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-aa6cc83a-218d-49c8-af71-5d195d08f9e5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.161212 Sep 11 10:49:28.656010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 183/376] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:28 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:29.678047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:29.678644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:29.684471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:29.684950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:29.685424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:29.686397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:29.686849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:29.687270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:29.823259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:29.831980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-84f3e292-9f78-4d12-a84e-faa6df6e24ac tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.157577 Sep 11 10:49:29.832997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 194/377] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:29 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:29.941415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:29.941923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:29.948592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:29.949080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:29.949546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:29.950274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:29.950728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:29.951706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:29.977000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:49:30.061924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-031e31e2-1013-4f68-bb99-48c4cb7edff0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "DELETE /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 204 len: 0 microversion: 2.1 time: 0.124063 Sep 11 10:49:30.062547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 184/378] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:49:29 2022] DELETE /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:49:30.070728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:30.071640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:30.079378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:30.079878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:30.080308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:30.080986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:30.081431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:30.081844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:30.210881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:30.219177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ae6549c3-1366-4ea3-a41d-cbb9a8f2988a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1503 microversion: 2.1 time: 0.152240 Sep 11 10:49:30.219784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 195/379] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:30 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:30.855515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:30.856245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:30.862789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:30.863278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:30.863736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:30.864434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:30.864884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:30.865307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:31.002438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:31.010217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8083ea6f-4c3e-4503-892c-99b553418cc0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.158882 Sep 11 10:49:31.010783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 185/380] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:30 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:31.242843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:31.243359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:31.250217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:31.250699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:31.251137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:31.251851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:31.252305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:31.252725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:31.383914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:31.392513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1c7d31f1-6173-44b8-a69d-73cd05eb39ec tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1503 microversion: 2.1 time: 0.153558 Sep 11 10:49:31.393080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 196/381] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:31 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:32.035080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:32.035728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:32.042687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:32.043187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:32.043664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:32.044379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:32.045094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:32.045583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:32.192077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:32.199718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a907f7e3-8cec-4298-abd1-9b11e473979b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.170502 Sep 11 10:49:32.200283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 186/382] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:32 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:32.416580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:32.417194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:32.423812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:32.424294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:32.424733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:32.425423 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:32.425878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:32.426301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:32.566437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:32.574439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1c6e6fb9-9297-44ef-a386-59231c8b0379 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1503 microversion: 2.1 time: 0.161679 Sep 11 10:49:32.575006 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 197/383] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:32 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:33.223197 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:33.224120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:33.230215 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:33.230709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:33.231323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:33.232931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:33.233554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:33.234408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:33.385474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:33.394465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e846c9e8-a660-437d-9bdd-fb3471d98212 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.175004 Sep 11 10:49:33.395132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 187/384] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:33 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:33.602542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:33.603027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:33.610306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:33.611522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:33.612125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:33.612839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:33.613301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:33.614220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:33.881877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:33.897100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-79a31716-b2c5-48ce-8b69-c3ef99896bf3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1503 microversion: 2.1 time: 0.298260 Sep 11 10:49:33.897710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 198/385] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:33 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:34.420664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:34.424388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:34.435316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:34.436330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:34.436997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:34.437779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:34.438320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:34.438785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:34.940536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:34.940536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:34.952907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:34.953844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:34.958463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:34.959558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:34.961337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:34.964640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:35.183462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:35.194843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-733bf2dd-e4da-437a-971a-b3260b1272eb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.778127 Sep 11 10:49:35.196232 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 188/386] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:34 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:35.433299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:35.441651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a9e4ce0f-5657-4539-a230-67412a41bcf9 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1503 microversion: 2.1 time: 0.519418 Sep 11 10:49:35.442229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 199/387] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:34 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1503 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:35.790946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8e81a1-8b0f-460e-ba32-85247c9fe1c9", "name": "network-vif-deleted", "tag": "c71124f1-c5ac-4ce4-a93d-a2197392f192"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:35.806504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:35.809195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:35.809647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:35.840356 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] Creating event network-vif-deleted:c71124f1-c5ac-4ce4-a93d-a2197392f192 for instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 on hv-cinder-85646 Sep 11 10:49:35.853252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-069113e0-13f4-4f5a-b48d-b6fb824774c5 req-9d09d89e-3b33-4a67-887b-9916f3e135b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066074 Sep 11 10:49:35.854090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 189/388] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:36.220964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:36.222639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:36.233324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.233833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.234277 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.234986 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.239168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.239733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.466758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:36.467774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:36.474425 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.475129 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.475900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.476933 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.477556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.479373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.520010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:36.524707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.530056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f6ed2ef2-8552-41b7-b0d4-5b038ec0ee56 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1502 microversion: 2.1 time: 0.315126 Sep 11 10:49:36.540026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.540641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.540757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 200/389] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:36 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:36.541492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lazy-loading 'fault' on Instance uuid da8e81a1-8b0f-460e-ba32-85247c9fe1c9 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:49:36.556764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4e48a0-26d4-4287-9a1d-d90df255632c"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:36.564244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:36.570715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.571505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.572127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.573006 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.574181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.574796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.599991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:36.606688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] HTTP exception thrown: Cannot 'attach_volume' instance fc097091-fee3-409f-89ea-48aa3782c5f5 while it is in vm_state rescued Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Request method failure captured: Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/os-volume_attachments HTTP/1.1 Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 74 Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyapJ6d7YaIKNmoRkGyG0j6dw_m_mO3dKCf5k-Boq5jePo2iEGW4FJQBwKwqxOV9xRFuJzzalZqmyX80rGwYB2MRfpmN-DbY-bNekyQezP1luSe-wYYdiBLMPxD4bwiH6vJK0p3S06ZJg7xritJMI7FPFoNLabXQPcf0tl3wshTV3Q Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:49:36.608949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_528ee82fc48247eea01a17898488ea3e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/528ee82fc48247eea01a17898488ea3e"}]}] Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f6eaba3a278e4bc99aca0dedd649fa9f Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {"volumeAttachment": {"volumeId": "7c4e48a0-26d4-4287-9a1d-d90df255632c"}} Sep 11 10:49:36.610226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Cannot 'attach_volume' instance fc097091-fee3-409f-89ea-48aa3782c5f5 while it is in vm_state rescued Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'server_id': 'fc097091-fee3-409f-89ea-48aa3782c5f5', 'body': {'volumeAttachment': {'volumeId': '7c4e48a0-26d4-4287-9a1d-d90df255632c'}}} Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:49:36.610993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fc097091-fee3-409f-89ea-48aa3782c5f5 while it is in vm_state rescued Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:49:36.612203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fc097091-fee3-409f-89ea-48aa3782c5f5 while it is in vm_state rescued Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Returning 409 to user: Cannot 'attach_volume' instance fc097091-fee3-409f-89ea-48aa3782c5f5 while it is in vm_state rescued {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6ed8588d-7001-4a57-ba9d-51d3be37bb23 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061956 Sep 11 10:49:36.613469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 201/390] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:49:36 2022] POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 10:49:36.619702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:36.620614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:36.628908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.630057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.630436 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b71fc36e-8b1b-425a-bf01-4433ccbef732 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 200 len: 1303 microversion: 2.1 time: 0.167927 Sep 11 10:49:36.631026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 190/391] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:36 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:36.632211 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.633193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.633810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.634579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.761877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cdfbe4f6-edf5-4f58-8b2a-595df9be2bd1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/action" status: 202 len: 0 microversion: 2.1 time: 0.145745 Sep 11 10:49:36.765503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 202/392] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:49:36 2022] POST /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 10:49:36.770728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:36.771757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:36.781324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.782070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.782700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:36.787481 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:36.788160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:36.788751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:37.159553 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:37.173065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-75262f8a-245d-4ab7-862f-109b2c9bd827 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.405744 Sep 11 10:49:37.174625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 191/393] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:36 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:37.656748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:37.657446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: da8e81a1-8b0f-460e-ba32-85247c9fe1c9] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:37.659650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=54 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:37.667816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:37.668559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:37.669130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:37.670677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:37.671272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:37.671906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:37.703391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] HTTP exception thrown: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Request method failure captured: Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 HTTP/1.1 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb0RTKZM8abAL3x5IyKlj3iORWxdIkI3rrHNuDq4KOFuCYk2z7tIm3AjlgrU5Gjha7eDLmCCHC_U8NRrz0ZS3ndGz5brVU0Dd6dhYTeTwN0eoOsPPLNEvmuPPnn9WZmPm5TkSBCGgGnDaTrinCVSSEpM466r_Vk2xyVuVIFBpJU5S1Y Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 6e5993a0a4964d7597bf4e2e8f252171 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-VolumesActionsTest-284260673 Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:49:37.707792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e5993a0a4964d7597bf4e2e8f252171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e5993a0a4964d7597bf4e2e8f252171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e5993a0a4964d7597bf4e2e8f252171", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e5993a0a4964d7597bf4e2e8f252171"}]}] Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-VolumesActionsTest-284260673 Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 6e5993a0a4964d7597bf4e2e8f252171 Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-VolumesActionsTest-284260673 Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-VolumesActionsTest-284260673-project Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 30f5e5a2ce8749d692600f1d2ab4fdb9 Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-VolumesActionsTest-284260673-project Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. Sep 11 10:49:37.709188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'da8e81a1-8b0f-460e-ba32-85247c9fe1c9'} Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:49:37.709880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. Sep 11 10:49:37.711004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:49:37.712077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Returning 404 to user: Instance da8e81a1-8b0f-460e-ba32-85247c9fe1c9 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:49:37.712077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e6de5508-268a-4813-b0f6-1e51c50e33f8 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9" status: 404 len: 111 microversion: 2.1 time: 0.057509 Sep 11 10:49:37.712077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 203/394] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:37 2022] GET /compute/v2.1/servers/da8e81a1-8b0f-460e-ba32-85247c9fe1c9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:49:37.855556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1838467236", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "networks": [{"uuid": "519cfee4-5d30-4dcb-92fd-c824f6b2acef"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:37.963450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] validate_networks() for [('519cfee4-5d30-4dcb-92fd-c824f6b2acef', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:49:38.198054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:38.198668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:38.204913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:38.205404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:38.206090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:38.207001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:38.207705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:38.208231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:38.535756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:38.547411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-537d1cb5-56ac-4c7e-9832-e0b72bd94445 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.353073 Sep 11 10:49:38.548758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 204/395] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:38 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:38.764895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:49:38.765475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:49:38.766037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:49:38.766450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:49:38.767028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:49:38.779814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:38.781167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:38.781635 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:38.782386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:38.783144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:38.783613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:38.802610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Getting quotas for project 6e5993a0a4964d7597bf4e2e8f252171. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:49:38.806737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Getting quotas for user 30f5e5a2ce8749d692600f1d2ab4fdb9 and project 6e5993a0a4964d7597bf4e2e8f252171. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:49:38.817785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:49:38.820124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:49:38.870098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ae18c2e4-4d42-4b01-9f86-8b13f1a1ecaa tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019163 Sep 11 10:49:38.871083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 192/396] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 10:49:38.882670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-656b4a40-3548-4e6c-8e2c-b62f9bc9ef53 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:38.883375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-656b4a40-3548-4e6c-8e2c-b62f9bc9ef53 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:38.953136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-656b4a40-3548-4e6c-8e2c-b62f9bc9ef53 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:38.963299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-656b4a40-3548-4e6c-8e2c-b62f9bc9ef53 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1214 microversion: 2.1 time: 0.084444 Sep 11 10:49:38.964442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 205/397] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:38 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:39.572362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:39.572969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:39.581355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:39.581839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:39.582273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:39.582964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:39.583414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:39.583858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:39.824447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:39.834909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8150093f-9f4c-4268-9036-b53f177858ef tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.266991 Sep 11 10:49:39.838845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 193/398] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:39 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:39.990335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:39.992307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:40.010828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:40.014865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:40.015543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:40.016450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:40.017034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:40.017330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:40.055153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:40.119680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:40.129258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c976eaad-4488-417f-ba64-82445923fc8f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1218 microversion: 2.1 time: 0.145052 Sep 11 10:49:40.130205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 206/399] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:39 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:40.862379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:40.863857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:40.871236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:40.872199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:40.873610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:40.874574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:40.875321 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:40.879353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:41.120750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:41.139940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a772882c-6d68-4e4f-acf2-dabf36167f02 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.281661 Sep 11 10:49:41.154438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:41.155715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:41.158688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 194/400] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:40 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:41.163617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:41.164110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:41.172246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:41.173011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:41.173641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:41.174292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:41.281882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:41.301157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f982979a-f185-4ab1-b357-9cd0543c8f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1210 microversion: 2.1 time: 0.150594 Sep 11 10:49:41.302183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 207/401] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:41 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:42.166574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:42.167251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:42.183460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:42.183958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:42.184402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:42.187891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:42.188413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:42.188866 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:42.326529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:42.327790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:42.334548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:42.335257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:42.336001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:42.336913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:42.337516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:42.338098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:42.355576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:42.360110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:42.373323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5276a07c-04a1-48f4-8048-4c9dd58facc1 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.210326 Sep 11 10:49:42.375309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 195/402] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:42 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:42.425913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:42.434233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5423cd30-78ab-4c9f-b55f-b481f49acfed tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1210 microversion: 2.1 time: 0.111892 Sep 11 10:49:42.451296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 208/403] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:42 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:43.399751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:43.400924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:43.412159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:43.412761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:43.413209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:43.413929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:43.414381 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:43.414990 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:43.458422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:43.459016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:43.465717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:43.466185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:43.466623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:43.467541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:43.472413 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:43.473191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:43.560840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:43.570762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-27dfed6a-7b91-4014-a0f5-2124f67420a1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1210 microversion: 2.1 time: 0.116390 Sep 11 10:49:43.588609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 209/404] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:43 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:43.621605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:43.630623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e84442a9-db10-456e-920b-6f4fbb24802f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1510 microversion: 2.1 time: 0.235746 Sep 11 10:49:43.631220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 196/405] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:43 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:44.595603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:44.597026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:44.606146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:44.606856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:44.608151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:44.608991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:44.609657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:44.610091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:44.682018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:44.693165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-702d9ac7-b6b5-4cec-91c1-a8cf171aa858 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1210 microversion: 2.1 time: 0.101783 Sep 11 10:49:44.703042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 197/406] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:44 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:44.721240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:44.721858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:44.727757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:44.728683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:44.729125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:44.729987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:44.730597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:44.731178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:44.772953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Action: 'create', calling method: .version_select at 0x7f75a0496ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-905934699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYsVVtDNQ76e1wKvJFQZ4sFMWeY3OegwMJOSfScuBZP2G4xO3D26AvJgYOGAbC4BJwoyWHv4ojSogKc2jH7kwZJX0NQCb33FrlVaNYcLDFie6WQsIuwXQpKqhtc5JujNw=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:44.817104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Getting quotas for project 587882642889489587749d5fb846acc6. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:49:44.821373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Getting quotas for user e839e78f400a46eb916b51c9e257bdf1 and project 587882642889489587749d5fb846acc6. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:49:44.835885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [461bdf92-326f-4682-83bd-523ae79d3f8e] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 10:49:44.908932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:44.916683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0acc6263-a889-498d-a8f0-c5bce636c20c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1516 microversion: 2.1 time: 0.212380 Sep 11 10:49:44.917242 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 198/407] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:44 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:45.717506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:45.718126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:45.725159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:45.725645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:45.726082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:45.726794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:45.727247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:45.727698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:45.800899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:45.808968 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f62c962a-79ef-4e9e-aa16-1d14c2fe3f85 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1266 microversion: 2.1 time: 0.095361 Sep 11 10:49:45.809782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 199/408] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:45 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:45.844461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [461bdf92-326f-4682-83bd-523ae79d3f8e] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 49484. Sep 11 10:49:45.861647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-33dd0fae-a4d2-49e7-a363-7dc4c133b969 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.304749 Sep 11 10:49:45.862884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 210/409] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:49:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:46.835939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:46.836643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:46.843924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:46.844422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:46.844861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:46.845571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:46.846031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:46.846491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:46.923019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:46.931073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-917c532b-26ca-4a16-af67-e81532718713 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1266 microversion: 2.1 time: 0.101995 Sep 11 10:49:46.931663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 200/410] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:46 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:47.955098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:47.955732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:47.961777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:47.962258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:47.962691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:47.963378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:47.963851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:47.964272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:48.026493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:48.034722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-072e8e7b-849d-43b4-b93d-54b25b0d4255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1266 microversion: 2.1 time: 0.084158 Sep 11 10:49:48.035273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 211/411] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:47 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:49.065948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:49.068178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:49.072235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:49.072886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:49.073753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:49.078460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:49.079299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:49.080016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:49.081366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:49.082269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:49.082723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:49.421468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:49.430266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2c185340-d8b8-461e-860c-9a48973f84f4 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1284 microversion: 2.1 time: 0.375677 Sep 11 10:49:49.430893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 201/412] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:49 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:50.454155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:50.455146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:50.461297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:50.461777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:50.462205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:50.462891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:50.463338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:50.463786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:50.530176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:50.537717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9d81bba6-7c73-45d0-9f16-4283235a5ba2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1272 microversion: 2.1 time: 0.087488 Sep 11 10:49:50.538268 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 212/413] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:50 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:51.562873 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:51.563546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:51.570064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:51.570545 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:51.570970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:51.571807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:51.572332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:51.572755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:51.636708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:51.646379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-787452cb-2bf6-46e3-be7d-526a90030387 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1272 microversion: 2.1 time: 0.088403 Sep 11 10:49:51.646952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 202/414] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:51 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:52.670254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:52.670855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:52.676806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:52.677276 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:52.677707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:52.678381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:52.678827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:52.679238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:52.741282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:52.749104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-90b316b8-483c-49fd-9d83-229dbb03794f tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1272 microversion: 2.1 time: 0.083012 Sep 11 10:49:52.749658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 213/415] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:52 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:53.772685 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:53.773415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:53.780478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:53.780965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:53.781404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:53.782097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:53.782555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:53.782983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:53.845556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:53.853268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-382f03a8-ca40-4cd5-a063-3e8f3e37f3c7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1272 microversion: 2.1 time: 0.084726 Sep 11 10:49:53.853861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 203/416] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:53 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:54.877604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:54.878129 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:54.879975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:54.885393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:54.885872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:54.886301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:54.886983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:54.887442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:54.888426 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:54.949084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:54.957491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f85157a1-9251-4e92-b367-95e14d93a3c0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1272 microversion: 2.1 time: 0.083503 Sep 11 10:49:54.958059 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 214/417] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:54 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:49:55.980959 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:55.981763 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:55.988854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:55.989334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:55.989761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:55.990447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:55.990891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:55.991303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:56.311547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:56.319015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-946a8b71-929b-405e-b7d7-a00a33c0867e tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.341817 Sep 11 10:49:56.319870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 204/418] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:55 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:56.992937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1bc291-a12b-476b-b1ee-29d438d2048f", "tag": "3664243d-8e5d-4c46-89c9-3672599ad966"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:57.003578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:57.004307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:57.005457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:57.020371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] Creating event network-changed:3664243d-8e5d-4c46-89c9-3672599ad966 for instance fb1bc291-a12b-476b-b1ee-29d438d2048f on hv-cinder-85646 Sep 11 10:49:57.029681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-9347e160-732b-46b5-8b9c-cbc5900aecc2 req-36adda9a-f8e7-44da-8f4c-9d90e5bc475e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039747 Sep 11 10:49:57.031281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 215/419] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:57.342559 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:57.343442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:57.349962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:57.350449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:57.351145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:57.352028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:57.352504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:57.353205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:57.561684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:57.569308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-75410300-ece1-4553-8817-b4b66b0d2df1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.231008 Sep 11 10:49:57.570212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 205/420] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:57 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:57.971363 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ddcee815-ce9d-4da4-a602-5cbee5c933ee tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: .version_select at 0x7f75a0364700>, body: {"keypair": {"name": "tempest-keypair-2089391357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMyrSJOCPiHNrOVpWhRTtnp3TjXx3Hsm1HD5/ZcIUfK0oVewQyvN3/lxbEMVjZjmR1Rg4tdqhml4s0nCMgVNaEQr+Q3+ErR1GwoPBG+nXJIS5PJXPiLnZg/SFqaDEMIzA=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:57.986840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-ddcee815-ce9d-4da4-a602-5cbee5c933ee tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for project 528ee82fc48247eea01a17898488ea3e. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:49:57.990592 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-ddcee815-ce9d-4da4-a602-5cbee5c933ee tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for user f6eaba3a278e4bc99aca0dedd649fa9f and project 528ee82fc48247eea01a17898488ea3e. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:49:58.014741 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ddcee815-ce9d-4da4-a602-5cbee5c933ee tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047590 Sep 11 10:49:58.015471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 216/421] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:49:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:49:58.592292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:58.592904 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:58.599165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:58.599721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:58.600153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:58.600849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:58.601543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:58.601728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:58.801496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:49:58.809106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a43fd132-228c-4ed3-863f-e4fe9a023772 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.220885 Sep 11 10:49:58.810014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 206/422] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:58 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:49:59.610475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-786245173", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "956ffae6-3fba-406d-940b-dead7ebd6612"}], "security_groups": [{"name": "tempest-securitygroup--114642904"}], "key_name": "tempest-keypair-2089391357", "user_data": "}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:49:59.716191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] validate_networks() for [('956ffae6-3fba-406d-940b-dead7ebd6612', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:49:59.831166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:49:59.831811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:49:59.838294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:59.838783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:59.839220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:49:59.839995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:49:59.840458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:49:59.841428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:00.061283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:00.068973 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e999cf1a-fa00-4f91-88b7-57c5fffb3dc1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.241559 Sep 11 10:50:00.069541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 207/423] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:49:59 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:00.164507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:50:00.164929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:50:00.165411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:50:00.165819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:50:00.166229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:50:00.175115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:00.175633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:00.176091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:00.176813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:00.177263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:00.177689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:00.194405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:50:00.198318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Getting quotas for user f6eaba3a278e4bc99aca0dedd649fa9f and project 528ee82fc48247eea01a17898488ea3e. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:50:00.210308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:50:00.212748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:50:00.258321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [59408600-4d12-4e59-88ba-a27e657972f9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 10:50:01.092942 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:01.093540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:01.099829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:01.100311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:01.100743 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:01.101428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:01.101878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:01.102300 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:01.237365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:01.245012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6badd289-02cc-4f3e-9f1d-e078c2224ca3 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.156413 Sep 11 10:50:01.245572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 208/424] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:01 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:01.265319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [59408600-4d12-4e59-88ba-a27e657972f9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 49732. Sep 11 10:50:01.269131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f619d1ae-4633-465c-8c6f-0f62090f36f7 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.664521 Sep 11 10:50:01.269790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 217/425] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:49:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:50:01.281664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d92324c2-9dcf-4f79-8972-a089672081cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:01.282281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d92324c2-9dcf-4f79-8972-a089672081cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:01.339890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d92324c2-9dcf-4f79-8972-a089672081cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:01.352331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d92324c2-9dcf-4f79-8972-a089672081cf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1245 microversion: 2.1 time: 0.075234 Sep 11 10:50:01.352893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 209/426] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:01 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:02.267919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:02.268885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:02.275033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:02.275730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:02.276160 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:02.276865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:02.277309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:02.277748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:02.376967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:02.377583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:02.384045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:02.384531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:02.384969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:02.385673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:02.386128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:02.386550 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:02.408945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:02.416497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-01b7b477-8157-4594-9756-7a3372e7cbb1 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.152571 Sep 11 10:50:02.417047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 218/427] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:02 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:02.448081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:02.455664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9a116a43-7d17-40ce-94a1-6f978bbe723a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.082469 Sep 11 10:50:02.456232 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 210/428] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:02 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:03.440903 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:03.441460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:03.447374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:03.447879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:03.448311 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:03.448991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:03.449438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:03.449890 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:03.477841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:03.478448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:03.485163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:03.485655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:03.486093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:03.486792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:03.487246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:03.487700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:03.563361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:03.570941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-efd905a4-191b-4fda-93dc-4b160ecd7e63 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.096864 Sep 11 10:50:03.571530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 211/429] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:03 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:03.599700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:03.607798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-188c9d64-dd28-4bbc-975e-43641331a719 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.170497 Sep 11 10:50:03.608360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 219/430] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:03 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:04.594325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:04.594959 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:04.601263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:04.601741 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:04.602172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:04.602863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:04.603309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:04.603761 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:04.631025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:04.631670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:04.638186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:04.638676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:04.639111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:04.639837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:04.640292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:04.640717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:04.667697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:04.675711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a6915604-a8d6-4a2e-a2e2-4657de68cfd6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.085757 Sep 11 10:50:04.676272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 212/431] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:04 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:04.768207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:04.776524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c79ffdd2-156e-4728-b220-25157ab0280a tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.149285 Sep 11 10:50:04.777087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 220/432] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:04 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:05.697853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:05.698466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:05.705575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:05.706058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:05.706495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:05.707189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:05.707669 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:05.708095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:05.725716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:05.769733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:05.777537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cf33db6d-f763-4d50-bd05-a2ccd0e73b72 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.083423 Sep 11 10:50:05.778131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 213/433] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:05 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:05.799792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:05.800393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:05.806354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:05.806833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:05.807260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:05.807968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:05.808415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:05.808831 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:05.940073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:05.947998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2006b1fc-e8dc-48b3-a902-615bfa3cece0 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.151997 Sep 11 10:50:05.948585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 221/434] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:05 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:06.799770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:06.800383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:06.806671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:06.807191 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:06.807664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:06.808353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:06.808808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:06.809306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:06.871524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:06.880043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ba02fcea-37cb-4fbd-8dee-d2e20e6440d6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.084116 Sep 11 10:50:06.880606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 214/435] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:06 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:06.971106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:06.971655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:06.977502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:06.977973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:06.978397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:06.979072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:06.979539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:06.979957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:07.108567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:07.116118 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4ea4ccc6-47ae-4a57-8ebd-6edb8712ba44 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.148888 Sep 11 10:50:07.116668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 222/436] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:06 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:07.903382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:07.903954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:07.910377 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:07.910865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:07.911302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:07.912033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:07.912485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:07.912903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:07.980278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:07.988325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f1a54cb3-5128-469d-a00b-77fa738426bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.088914 Sep 11 10:50:07.988888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 215/437] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:07 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:08.140997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:08.141648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:08.143576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:08.148868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:08.149351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:08.149782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:08.150469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:08.150941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:08.151365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:08.278083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:08.285842 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-72ff28e0-436f-409b-abd0-109700c4d958 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.149479 Sep 11 10:50:08.286410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 223/438] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:08 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:09.011493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:09.012055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:09.015037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 10:50:09.015179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sun Sep 11 10:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b (ip 10.222.0.15) !!! Sep 11 10:50:09.026839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:09.027329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:09.027886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:09.029309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:09.029775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:09.030208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:09.091412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:09.099199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7f2bc3af-66fb-4544-975e-63e9a2722eed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.091618 Sep 11 10:50:09.099796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 216/439] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:09 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:09.309876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:09.310627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:09.316543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:09.317038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:09.317575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:09.318259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:09.318701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:09.319117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:09.453602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:09.461215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5197a245-4c50-46c7-897f-c3d6ae1e5f52 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.155789 Sep 11 10:50:09.461764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 224/440] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:09 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:10.121938 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:10.122547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:10.129072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:10.129555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:10.129991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:10.130680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:10.131134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:10.131588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:10.191067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:10.198611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-45c1dc05-cdc0-424c-85d9-ea1f41c56187 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.080584 Sep 11 10:50:10.199164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 217/441] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:10 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:10.486402 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:10.487665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:10.493815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:10.494835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=10 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:10.496298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:10.496951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:10.497921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:10.499191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:10.499935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:10.500721 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:10.506321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=93 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:10.637648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:10.646381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a8d3b8d1-d459-4459-be29-61a0fc9ccc92 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.166828 Sep 11 10:50:10.646946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 225/442] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:10 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:11.225396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:11.226415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:11.234725 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:11.235205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:11.235742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:11.236557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:11.237066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:11.237671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:11.313087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:11.322264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b20d1d65-d796-4d41-a850-ab77bde4c5b5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.103395 Sep 11 10:50:11.322837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 218/443] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:11 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:11.669965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:11.670861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:11.676900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:11.677384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:11.677817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:11.678514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:11.678965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:11.679383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:11.819392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:11.827699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a740d032-4bc7-4388-963e-26d5c6bdf41b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.161527 Sep 11 10:50:11.828258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 226/444] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:11 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:12.350312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:12.350918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:12.352790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:12.359452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:12.359948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:12.360391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:12.361115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:12.361598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:12.362074 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:12.437361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:12.445322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ae808212-449e-43ee-bcff-1f558eb4326a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1249 microversion: 2.1 time: 0.098726 Sep 11 10:50:12.460368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 219/445] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:12 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:12.851850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:12.852460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:12.858933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:12.859415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:12.859874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:12.860559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:12.861015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:12.861437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:12.997114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:13.005776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0f3e398e-f956-43c8-ac26-6ad9dae35253 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.157773 Sep 11 10:50:13.006330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 227/446] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:12 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:13.470644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:13.471256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:13.478698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:13.479836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:13.479836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:13.480395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:13.480857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:13.482052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:13.552930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:13.560739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-931e08e8-53f9-4ad8-a3a7-2601e3df4626 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1303 microversion: 2.1 time: 0.094800 Sep 11 10:50:13.561886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 220/447] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:13 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:14.031300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:14.032135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:14.038394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:14.038879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:14.039321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:14.040048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:14.040507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:14.040930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:14.261258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:14.270539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-703285d4-dc4c-48d8-937d-6b813987ddf7 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.244516 Sep 11 10:50:14.271567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 228/448] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:14 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:14.585609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:14.586218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:14.593914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:14.594627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:14.595226 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:14.596100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:14.596820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:14.597459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:14.860532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:14.871979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7ccc1bc9-8c7b-4734-b7c0-943772a9c078 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.290962 Sep 11 10:50:14.872778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 221/449] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:14 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:15.086141 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:15.101496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:15.101979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:15.103063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:15.115517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] Creating event network-changed:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:50:15.121063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-001b33de-7133-48aa-b295-6cf7d7951e36 req-cbfcf2a8-f058-44f4-b65f-44af7d0f6783 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Sep 11 10:50:15.121676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 229/450] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:15.294201 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:15.295700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:15.301863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:15.302340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:15.302771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:15.303642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:15.304093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:15.304517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:15.510000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:15.518943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f3207678-e136-4c32-9aa0-2a01045f961b tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.228627 Sep 11 10:50:15.519864 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 222/451] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:15 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:15.900568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:15.901288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:15.908203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:15.909729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:15.910166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:15.910865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:15.911321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:15.911772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:16.088935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:16.097438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7a49d529-eeb2-440e-b4c1-c78084e2fc88 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.201054 Sep 11 10:50:16.098087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 230/452] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:15 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:16.542360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:16.543605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:16.551777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:16.552272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:16.552709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:16.553408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:16.553862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:16.558544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:16.695178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:16.699228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1bc291-a12b-476b-b1ee-29d438d2048f", "name": "network-vif-plugged", "status": "completed", "tag": "3664243d-8e5d-4c46-89c9-3672599ad966"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:16.704155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bcb1d648-38d4-4293-a90d-cb368dd160c2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.165905 Sep 11 10:50:16.710923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:16.711403 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:16.711868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:16.715811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 223/453] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:16 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:16.725033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] Creating event network-vif-plugged:3664243d-8e5d-4c46-89c9-3672599ad966 for instance fb1bc291-a12b-476b-b1ee-29d438d2048f on hv-cinder-85646 Sep 11 10:50:16.730134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-5492c7d1-2a16-4f5f-b326-b629d7574fcc req-670c895c-e273-488f-af88-26eebfb322e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Sep 11 10:50:16.730872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 231/454] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:50:17.121073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:17.121721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:17.128035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:17.128527 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:17.128960 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:17.129659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:17.130227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:17.130580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:17.295819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:17.304980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-866c8a02-8f51-47c3-ab5f-4b4f73c7be4e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.187083 Sep 11 10:50:17.305735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 224/455] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:17 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:17.728465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:17.729773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:17.737122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:17.737890 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:17.738520 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:17.739435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:17.740108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:17.740719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:18.227107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:18.236077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7a83ba22-d73f-49aa-8d36-4f57fe3fe255 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.511696 Sep 11 10:50:18.236762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 232/456] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:17 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:18.333288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:18.334593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:18.345085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:18.345897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:18.346604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:18.347559 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:18.348253 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:18.348881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:18.604993 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:18.614948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-aaaf0dee-32a9-4b1b-8164-9601c056d7a3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.285860 Sep 11 10:50:18.615555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 225/457] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:18 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:19.259879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:19.260616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:19.268152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:19.269003 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:19.269660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:19.270542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:19.271162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:19.271629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:19.471202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:19.480397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bd1cd18d-64fc-4b61-8669-f3e271eb8f65 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.224840 Sep 11 10:50:19.481190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 233/458] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:19 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:19.640478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:19.641638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:19.648047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=52 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:19.650212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:19.651469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:19.651469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:19.652332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:19.652776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:19.653287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:19.907175 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:19.916177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2a2d2479-e0ba-4dc2-ab01-bc6fa249503d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.281838 Sep 11 10:50:19.921526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 226/459] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:19 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:20.505609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:20.506869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:20.513438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:20.514830 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:20.515625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:20.516562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:20.517086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:20.517576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:20.698538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:20.706411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-869527c1-acc7-46aa-a7ee-d0d85e3daeeb tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.204858 Sep 11 10:50:20.707068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 234/460] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:20 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:20.940505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:20.941829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:20.949265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:20.949951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:20.950562 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:20.952289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:20.952915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:20.953502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:21.180820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:21.190701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-35dc8ec3-2ddf-4aa3-87ed-79b37bffc763 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.254736 Sep 11 10:50:21.197705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 227/461] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:20 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:21.733078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:21.734547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:21.740835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:21.741516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:21.742121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:21.742978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:21.743612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:21.744182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:21.918271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:21.931753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-77754383-0001-4f55-be33-87102bf21978 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.204187 Sep 11 10:50:21.933031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 235/462] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:21 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:22.213967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:22.214583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:22.225687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:22.227106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:22.227735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:22.228518 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:22.229150 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:22.229934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:22.428000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:22.435915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a859b3d9-cb9b-4d49-aace-e85f657c4f4d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.225350 Sep 11 10:50:22.436681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 228/463] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:22 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:22.956714 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:22.957394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:22.963373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:22.963892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:22.964338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:22.965025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:22.965784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:22.967811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:23.134414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:23.145427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ef6c78bf-c2f4-445b-a206-0ccfebc589bd tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.192531 Sep 11 10:50:23.160982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 236/464] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:22 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:23.460998 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:23.462765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:23.481594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:23.483606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:23.484354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:23.485606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:23.486418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:23.487046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:23.668878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:23.679857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b0c585e6-7804-443e-8f4e-643b8217996f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.223711 Sep 11 10:50:23.695966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 229/465] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:23 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:24.170149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:24.170587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:24.179526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:24.183046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:24.183914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:24.192831 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:24.193323 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:24.193769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:24.668375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:24.676410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-28b44a2f-93df-45c2-bcae-e5cc94eed527 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.511482 Sep 11 10:50:24.677507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 237/466] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:24 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:24.723064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:24.725488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:24.732854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:24.733472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:24.734114 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:24.734991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:24.735629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:24.736203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:24.740668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:24.894166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:24.902533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-497cda4a-7fe2-4430-9ac6-483b89c84f8f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.183312 Sep 11 10:50:24.903296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 230/467] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:24 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:25.632816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1562137817", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-905934699", "security_groups": [{"name": "tempest-secgroup-smoke-1655449648"}], "networks": [{"uuid": "fd9dbbc9-5825-4154-ab06-9ff4113df779"}], "block_device_mapping_v2": [{"uuid": "d21d951e-4157-4914-b661-b656ef333f9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:25.701086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:25.701674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:25.712168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:25.714428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:25.715033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:25.716005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:25.720604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:25.721794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:26.041660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] validate_networks() for [('fd9dbbc9-5825-4154-ab06-9ff4113df779', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:50:26.436536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:26.445867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-869c9e4a-5bc4-4430-9811-8b9c979c3497 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1314 microversion: 2.1 time: 0.749276 Sep 11 10:50:26.446422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 231/468] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:25 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:26.458850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:26.459784 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:26.471459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:26.472296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:26.473606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:26.474428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:26.474952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:26.475465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:26.789551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:26.805550 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-10a98651-5e13-4ef8-af77-2c8e4dbeb270 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.352408 Sep 11 10:50:26.809384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 232/469] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:26 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:26.829237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "name": "network-vif-plugged", "status": "completed", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:26.842265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:26.843834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:26.844977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:26.864247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] Creating event network-vif-plugged:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:50:26.873795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-61cbeade-f0d3-45ee-acb9-b1489b1b7b19 req-8cd350cf-58f1-4e01-ab39-488ce85d010d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062900 Sep 11 10:50:26.874948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 233/470] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:27.294406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:50:27.296132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:50:27.296937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:50:27.297532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:50:27.297947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:50:27.325319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.326107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.326554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.327294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.327779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.328206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.354542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Getting quotas for project 587882642889489587749d5fb846acc6. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:50:27.360988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Getting quotas for user e839e78f400a46eb916b51c9e257bdf1 and project 587882642889489587749d5fb846acc6. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:50:27.460748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:50:27.463056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d21d951e-4157-4914-b661-b656ef333f9e',volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:50:27.476370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:27.477775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:27.492560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.494284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.495696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.496676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.498845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.501723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.672340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ae3eecab-e9e7-4327-a336-2933db5c69d6 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.043410 Sep 11 10:50:27.679929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 238/471] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:50:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:50:27.688321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b804f5dc-cd6f-4320-99c3-769cea82059b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:27.689066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b804f5dc-cd6f-4320-99c3-769cea82059b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:27.817980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b804f5dc-cd6f-4320-99c3-769cea82059b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:27.827527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b804f5dc-cd6f-4320-99c3-769cea82059b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1088 microversion: 2.1 time: 0.146045 Sep 11 10:50:27.851807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 239/472] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:27 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1088 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:27.863599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:27.864455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:27.871621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.872464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.873186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.874138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:27.874808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:27.875484 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:27.944572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:27.959920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e2b8806f-8d8c-4de5-8623-0dcbd0e8e8ac tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1499 microversion: 2.1 time: 0.489082 Sep 11 10:50:27.960526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 234/473] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:27 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1499 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:28.144351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:28.151928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-14fe2652-0b65-4cee-8782-5b0fbdb9aee3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.298849 Sep 11 10:50:28.168820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 240/474] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:27 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:28.670847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:28.671601 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:28.680939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.684122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.695978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:28.697510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.698225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.698982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:28.740416 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:50:28.860452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:28.862786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:28.869650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-663d4e51-e576-4317-b7ee-57ba2c146d73 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 204 len: 0 microversion: 2.1 time: 0.203094 Sep 11 10:50:28.874030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 235/475] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:50:28 2022] DELETE /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:50:28.892754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:28.896734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.897234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.897683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:28.898393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.898841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.903434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:28.905672 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:28.917383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.917873 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.918306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:28.919015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:28.919514 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:28.920161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:29.088559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:29.098845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bb62f51e-33e8-4a97-91ef-182eb08d2500 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1130 microversion: 2.1 time: 0.244609 Sep 11 10:50:29.113864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 241/476] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:28 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1130 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:29.135390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:29.145493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7205d71e-f038-4b4a-8a1e-5764f9d2ed3d tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1505 microversion: 2.1 time: 0.260645 Sep 11 10:50:29.147575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 236/477] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:28 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:29.178936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:29.182052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:29.193119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:29.194177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:29.195478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:29.196790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:29.197265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:29.198105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:29.361391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:29.369478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-da45b54a-cce1-4f2c-b16c-c97c9ef74b73 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1370 microversion: 2.1 time: 0.195727 Sep 11 10:50:29.370056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 237/478] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:29 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:29.448142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-11c92449-4151-49aa-8cb5-02ca79215dd8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Action: 'create', calling method: .version_select at 0x7f75a03533a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-13039510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVe/M+5bqhgE08tajeFwk/KkRI+Pv8JCMUnC013yLLsUs44QbaDNjXUA/fNKANuefFxRAEJh4++cIHJLKene6EIvTT3+1lMnTbs4i+x81nzby74SUCiYhPPbmrac4gCmg=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:29.470566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-11c92449-4151-49aa-8cb5-02ca79215dd8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for project 23556239691f46aa8b39bb6219fc591f. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:50:29.474752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-11c92449-4151-49aa-8cb5-02ca79215dd8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for user e1b0815853b947bc8f50d91c1ce0ab5a and project 23556239691f46aa8b39bb6219fc591f. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:50:29.497216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-11c92449-4151-49aa-8cb5-02ca79215dd8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.385872 Sep 11 10:50:29.498522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 242/479] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:50:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:30.125925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:30.126597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:30.133307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.133801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.134239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.135412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.136071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.136680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.169359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:30.171461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:30.178751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.179493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.179927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.180619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.181063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.181475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.246724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:30.257941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c6c0f57c-209f-45de-af72-f386c29fbfa0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1186 microversion: 2.1 time: 0.137511 Sep 11 10:50:30.258540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 238/480] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:30 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:30.394898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:30.396249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:30.401585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:30.419572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.420346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-94654f73-0179-44fa-a926-c93e1129e794 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1505 microversion: 2.1 time: 0.251571 Sep 11 10:50:30.421167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 243/481] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:30 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:30.424135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.424726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.427879 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.429890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.430551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.630223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:30.639011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-de7c59f4-d4df-4fbb-803e-90138341bb5a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1565 microversion: 2.1 time: 0.248320 Sep 11 10:50:30.639836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 239/482] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:30 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1565 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:30.661289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:30.661776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:30.667697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.668174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.668783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.670395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:30.671161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:30.671929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:30.783115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bbca82da-4746-4ffb-8511-9b4473b84091 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125640 Sep 11 10:50:30.783750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 244/483] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 10:50:30 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:31.281266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:31.282472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:31.291135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:31.292365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:31.300312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:31.301843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:31.302751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:31.303329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:31.447275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:31.449281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:31.457921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:31.465965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-07b55548-d3db-454c-80ef-2da4ae07e9e1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1186 microversion: 2.1 time: 0.188970 Sep 11 10:50:31.467170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 240/484] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:31 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1186 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:31.476354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:31.476841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:31.477271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:31.486081 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:31.487820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:31.491083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:31.850408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:31.860504 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e0d4e65b-264c-48c2-a618-2d17cedcf2a2 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1505 microversion: 2.1 time: 0.418490 Sep 11 10:50:31.866979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 245/485] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:31 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:32.492006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:32.493171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:32.510313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.511063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.511708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.513301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.513970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.514582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.715243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:32.730310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1bc291-a12b-476b-b1ee-29d438d2048f", "name": "network-vif-deleted", "tag": "3664243d-8e5d-4c46-89c9-3672599ad966"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:32.733513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-055e0c9f-d148-4e28-9ae1-11556ab65e26 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1204 microversion: 2.1 time: 0.244235 Sep 11 10:50:32.750220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.752836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.754052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.758742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:32.783405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] Creating event network-vif-deleted:3664243d-8e5d-4c46-89c9-3672599ad966 for instance fb1bc291-a12b-476b-b1ee-29d438d2048f on hv-cinder-85646 Sep 11 10:50:32.800108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-16ace237-db78-4dd9-bf1c-393a86b6cde7 req-cb3e081a-ba60-4c8f-b48b-5ad7cc0be5a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073447 Sep 11 10:50:32.802106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 246/486] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:50:32.807785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 241/487] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:32 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1204 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:32.892316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:32.893281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:32.905612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.908837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.909504 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.912354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.912940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.913375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.965247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:32.966690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:32.967291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:32.967930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lazy-loading 'fault' on Instance uuid fb1bc291-a12b-476b-b1ee-29d438d2048f {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:50:33.126566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f5e5a2ce8749d692600f1d2ab4fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5993a0a4964d7597bf4e2e8f252171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:33.136482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-aaa2c0fe-94fd-44a1-b748-a9a62b9ed9ae tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 200 len: 1304 microversion: 2.1 time: 0.249483 Sep 11 10:50:33.137759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 247/488] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:32 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:33.364691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:33.379505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:33.382045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:33.382567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:33.408586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] Creating event network-changed:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:50:33.419559 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-29bdee86-679b-4bf5-a208-0709a87f2c80 req-631a280e-5c0e-4c0e-8c2b-d067558d3186 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058443 Sep 11 10:50:33.422166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 242/489] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:33.759919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:33.760524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:33.778456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:33.785263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:33.785819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:33.786580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:33.787047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:33.791638 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:34.162922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:34.163653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] [instance: fb1bc291-a12b-476b-b1ee-29d438d2048f] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:34.178609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:34.179151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:34.179841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:34.189103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:34.189391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:34.189831 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:34.237542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] HTTP exception thrown: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Request method failure captured: Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f HTTP/1.1 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb0RTKZM8abAL3x5IyKlj3iORWxdIkI3rrHNuDq4KOFuCYk2z7tIm3AjlgrU5Gjha7eDLmCCHC_U8NRrz0ZS3ndGz5brVU0Dd6dhYTeTwN0eoOsPPLNEvmuPPnn9WZmPm5TkSBCGgGnDaTrinCVSSEpM466r_Vk2xyVuVIFBpJU5S1Y Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 6e5993a0a4964d7597bf4e2e8f252171 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesActionsTest-284260673 Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:50:34.239259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e5993a0a4964d7597bf4e2e8f252171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e5993a0a4964d7597bf4e2e8f252171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e5993a0a4964d7597bf4e2e8f252171", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e5993a0a4964d7597bf4e2e8f252171"}]}] Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesActionsTest-284260673 Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 6e5993a0a4964d7597bf4e2e8f252171 Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesActionsTest-284260673 Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesActionsTest-284260673-project Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 30f5e5a2ce8749d692600f1d2ab4fdb9 Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesActionsTest-284260673-project Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. Sep 11 10:50:34.242162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'fb1bc291-a12b-476b-b1ee-29d438d2048f'} Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:50:34.243233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. Sep 11 10:50:34.245108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:50:34.247016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] Returning 404 to user: Instance fb1bc291-a12b-476b-b1ee-29d438d2048f could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:50:34.247016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5ad237a2-dbe8-4da9-9503-f01fefce9f36 tempest-VolumesActionsTest-284260673 tempest-VolumesActionsTest-284260673-project] 10.222.0.15 "GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f" status: 404 len: 111 microversion: 2.1 time: 0.083558 Sep 11 10:50:34.251840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 243/490] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:34 2022] GET /compute/v2.1/servers/fb1bc291-a12b-476b-b1ee-29d438d2048f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:50:34.725565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:34.738310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5884626e-e348-49f8-a695-669b00e8a8a1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.982443 Sep 11 10:50:34.740310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 248/491] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:33 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:35.659964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:50:35.673228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:35.674187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:35.674827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:35.688663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] Creating event network-changed:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:50:35.693917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-f8be916f-f2c4-473f-8b99-4bc6d3f5a090 req-da2977d6-1f77-4742-8bb3-2a550ced8719 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Sep 11 10:50:35.694692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 244/492] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:50:35.762610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:35.764571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:35.775154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:35.776225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:35.777326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:35.778367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:35.781249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:35.782067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:35.943945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:35.952833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a5acc2bd-ad27-4dfb-80f1-7e0e0c0abee3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.194615 Sep 11 10:50:35.953637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 249/493] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:35 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:36.977353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:36.977947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:36.985488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:36.985966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:36.986396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:36.987078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:36.987557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:36.987978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:37.122974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:37.130745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f09e9dda-79af-4e0c-bcbd-c29d6a8ea5ce tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.158271 Sep 11 10:50:37.131366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 245/494] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:36 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:38.154620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:38.155232 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:38.157531 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:38.158317 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:38.164412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:38.164826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:38.165260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:38.166011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:38.166471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:38.166896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:38.349945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:38.358181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4ae796b2-fd3d-4fb5-9704-8c1691d2ac90 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.207892 Sep 11 10:50:38.358817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 250/495] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:38 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:39.384880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:39.384880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:39.391937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:39.392430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:39.392869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:39.393571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:39.394022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:39.394447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:39.525364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:39.533513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5e9e2d58-d8d3-4803-8949-bad240ef7fe1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.156724 Sep 11 10:50:39.534072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 246/496] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:39 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:40.556710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:40.557249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:40.559058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=12 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:40.564581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:40.565065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:40.565497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:40.566177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:40.566627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:40.567044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:40.693887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:40.702520 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-629bf93d-683c-4bc8-9841-7d0e256829eb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.149688 Sep 11 10:50:40.703070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 251/497] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:40 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:41.726034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:41.726667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:41.733546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:41.734022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:41.734451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:41.735134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:41.735619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:41.736064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:41.886670 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:41.890463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:41.896506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9b0226fd-a0a7-45da-b52e-de27e57b9824 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.174310 Sep 11 10:50:41.897076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 247/498] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:41 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:42.919316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:42.919954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:42.925880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:42.926356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:42.926787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:42.927490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:42.927941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:42.928360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:43.062422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:43.070122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-300ef2cc-3d7b-4037-b813-fa4bbb7a7b70 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.154696 Sep 11 10:50:43.070675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 252/499] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:42 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:44.094332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:44.094936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:44.101860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:44.102345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:44.102798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:44.103502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:44.103954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:44.104378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:44.237445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:44.245025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-64fab0ce-57c0-47c0-a318-f2c624cfe509 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.155792 Sep 11 10:50:44.245585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 248/500] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:44 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:45.269324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:45.269939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:45.277105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:45.277738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:45.278212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:45.278964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:45.279447 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:45.279872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:45.413957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:45.422198 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d68a9dbc-8554-40cc-b484-09a9657d685d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.157666 Sep 11 10:50:45.422760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 253/501] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:45 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:46.445406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:46.446056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:46.453079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:46.453565 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:46.453999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:46.454688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:46.455143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:46.455593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:46.585673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:46.593599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8fd66234-1ee5-4e13-8b8e-df938be3e4cc tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.152047 Sep 11 10:50:46.594168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 249/502] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:46 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:47.616731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:47.617263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:47.623110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:47.623635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:47.624074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:47.624760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:47.625243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:47.625719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:47.755563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:47.763074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c751a4bb-23fd-4f5b-9e0a-57cd1bd4c4cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.150223 Sep 11 10:50:47.763668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 254/503] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:47 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:48.785513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:48.786120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:48.792199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:48.792682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:48.793117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:48.793814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:48.794252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:48.794676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:48.926812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:48.934849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8dba18dc-78cf-4813-92d8-b9622b58f9ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.153192 Sep 11 10:50:48.935413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 250/504] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:48 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:49.958857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:49.959390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:49.965470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:49.965953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:49.966359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:49.967074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:49.967695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:49.968199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:50.117188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:50.125353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-272dd3f8-289b-44ff-87b1-2a35d782fe18 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.170341 Sep 11 10:50:50.126146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 255/505] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:49 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:51.150001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:51.150695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:51.160936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:51.164061 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:51.165029 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:51.165567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:51.166715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:51.167594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:51.168288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:51.428964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:51.442190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b1ca8ed4-bcb8-4d80-bda3-527d7e538f0f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.296842 Sep 11 10:50:51.442782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 251/506] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:51 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:52.472469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:52.473231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:52.479481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:52.479967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:52.480399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:52.481092 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:52.481540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:52.481958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:52.631929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:52.646643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b7ee1518-b372-4b12-b584-ef9dccb762ff tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.177788 Sep 11 10:50:52.647232 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 256/507] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:52 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:53.669190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:53.671760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:53.678772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:53.679490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:53.679929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:53.680704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:53.681150 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:53.681724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:53.821552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:53.830408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-476a4d99-507e-4fda-b39f-7d4d1d7ca036 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.165121 Sep 11 10:50:53.846656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 252/508] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:53 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:54.855727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:54.857213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:54.867496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:54.868257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:54.868849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:54.869811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:54.871513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:54.872189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:55.067036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:55.079851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ab8e81b5-8624-4b93-ad60-d54671e715ec tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.229171 Sep 11 10:50:55.082439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 257/509] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:54 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:56.108682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:56.110039 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:56.116337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:56.117062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:56.117497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:56.118361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:56.119179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:56.119655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:56.270556 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:56.285932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cc3cc7ba-618d-4d2d-9be0-5058f2aa5ac5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.179833 Sep 11 10:50:56.286705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 253/510] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:56 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:50:57.314585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:57.316984 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:57.327855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:57.328502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:57.329239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:57.330191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:57.330800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:57.331965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:57.494704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:57.508106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0da6403e-9464-4bed-b67f-a40ac6cc0bc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.196166 Sep 11 10:50:57.508106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 258/511] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:57 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:58.530592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:58.532254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:58.539806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:58.540717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:58.541229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:58.542051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:58.542707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:58.543131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:58.713245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:58.723234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4a3a61f4-8734-4069-b7c8-4d458d6d0606 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.196607 Sep 11 10:50:58.723851 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 254/512] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:58 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:50:59.746406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:50:59.747033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:50:59.756172 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:59.756671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:59.757109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:59.757815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:50:59.758268 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:50:59.758691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:50:59.979998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:50:59.995647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-693ffcb7-70d9-4260-bbd9-e80c80eb5523 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.253133 Sep 11 10:51:00.016319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 259/513] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:50:59 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:00.611795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "name": "network-vif-plugged", "status": "completed", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:00.624135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:00.625051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:00.625710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:00.642818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] Creating event network-vif-plugged:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:51:00.648533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-c0f4fdf3-1b59-45d8-8f8f-7b4a6cd8cab2 req-3e6ad39c-2a09-46d5-9180-2839016c2d79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Sep 11 10:51:00.649540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 255/514] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:01.024587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:01.025194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:01.049765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:01.050470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:01.051065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:01.053337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:01.054298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:01.056431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:01.251152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:01.263282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ccc85615-0038-4390-8d1e-237c5c83e623 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.242515 Sep 11 10:51:01.272426 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 260/515] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:01 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:02.288900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:02.289896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:02.299701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:02.300582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:02.301248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:02.302216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:02.302897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:02.303582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:02.478993 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:02.489363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fb5175dc-817b-489c-84e9-d330ef7b864a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.205992 Sep 11 10:51:02.490367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 256/516] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:02 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:03.517641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:03.527636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:03.536808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:03.537634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:03.538382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:03.539807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:03.540520 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:03.541331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:03.546577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=88 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:03.714666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:03.722984 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-25351709-2a8c-4854-8b8b-3d357975115f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1260 microversion: 2.1 time: 0.211476 Sep 11 10:51:03.723827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 261/517] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:03 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:04.759055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:04.759717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:04.767415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:04.767944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:04.768370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:04.769079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:04.769526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:04.769948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:05.006751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:05.020546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fa30529d-557f-4876-9955-29a97097c0d4 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1444 microversion: 2.1 time: 0.272310 Sep 11 10:51:05.020546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 257/518] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:04 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1444 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:05.038952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:05.039844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:05.049633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:05.050415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:05.051151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:05.051568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:05.052018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:05.052438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:05.217490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:05.225868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-62425148-f975-46a6-a02a-9fb76a449cc3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1444 microversion: 2.1 time: 0.190779 Sep 11 10:51:05.226679 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 262/519] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:05 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1444 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:07.726848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1822016255", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-13039510", "security_groups": [{"name": "tempest-secgroup-smoke-1317451716"}], "block_device_mapping_v2": [{"uuid": "1ac92a16-8cfb-4718-b667-538443f319b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2be92be9-cd67-4fcc-bf1b-6ceeb89de07d"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:07.969969 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] validate_networks() for [('2be92be9-cd67-4fcc-bf1b-6ceeb89de07d', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:51:08.151764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:08.171886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:08.172371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:08.173045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:08.201386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] Creating event network-changed:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:51:08.211132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-458f2f96-3905-42e2-8a8c-29b2c1e950e7 req-64c8d20c-27cf-48d4-b28d-58836189fa30 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062838 Sep 11 10:51:08.212641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 263/520] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:08.769571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:51:08.770519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:51:08.771175 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:51:08.771722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:51:08.772087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:51:08.785782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:08.786495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:08.787090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:08.788028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:08.789100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:08.789713 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:08.817348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:51:08.823307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for user e1b0815853b947bc8f50d91c1ce0ab5a and project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:51:08.959930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:51:08.962430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ac92a16-8cfb-4718-b667-538443f319b5',volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:51:09.195184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1a76b669-02df-456a-b012-c89b68ee1aa1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.472239 Sep 11 10:51:09.202362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 258/521] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:51:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:51:09.208822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9f79bfb0-6fa5-446b-9278-6883891d2e3d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:09.209528 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9f79bfb0-6fa5-446b-9278-6883891d2e3d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:09.211948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=28 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:09.399535 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9f79bfb0-6fa5-446b-9278-6883891d2e3d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:09.410037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9f79bfb0-6fa5-446b-9278-6883891d2e3d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1093 microversion: 2.1 time: 0.205723 Sep 11 10:51:09.413206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 264/522] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:09 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1093 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:10.453974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:10.455612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:10.464032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:10.464689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:10.465281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:10.466116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:10.466928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:10.468153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:10.579469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:10.591181 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-10f7ca1c-f1ad-4935-8435-0e5164d085c6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1191 microversion: 2.1 time: 0.141968 Sep 11 10:51:10.592439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 259/523] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:10 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1191 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:11.614971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:11.616184 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:11.623961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:11.624647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:11.625092 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:11.625910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:11.626676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:11.627171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:11.727543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:11.736635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-88522e07-1d04-42fb-b07c-f16af1f202e6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1209 microversion: 2.1 time: 0.125819 Sep 11 10:51:11.737390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 265/524] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:11 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:12.760300 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:12.760913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:12.768070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:12.768561 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:12.769098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:12.769706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:12.770165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:12.770594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:12.958386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:12.966686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-25466ac0-dbbf-4e1b-83fe-b91ae11e78bf tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.210378 Sep 11 10:51:12.967257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 260/525] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:12 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:13.025325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646d54e0-29b4-45c0-aa4b-4d540825d887", "tag": "e62f0749-ab15-40f3-b785-e90aadfb68ed"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:13.038341 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:13.038828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:13.039262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:13.050870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] Creating event network-changed:e62f0749-ab15-40f3-b785-e90aadfb68ed for instance 646d54e0-29b4-45c0-aa4b-4d540825d887 on hv-cinder-85646 Sep 11 10:51:13.056353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-a9f26b15-7535-4e61-bbc5-c90002da8b70 req-8ec29661-fbec-4731-873b-623d6568b3b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034655 Sep 11 10:51:13.056952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 266/526] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:13.989952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:13.990567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:13.997042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:13.997545 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:13.998246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:13.999020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:14.000125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:14.002245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:14.144026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:14.146297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=75 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:14.153405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-867bc656-065c-45b9-8f29-aefc9810174a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.167528 Sep 11 10:51:14.155069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 261/527] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:13 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:15.177674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:15.178366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:15.184541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:15.185573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:15.187270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:15.188017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:15.188473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:15.188895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:15.357999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:15.366052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e123fa55-c03e-4992-808e-9067ff4f6cef tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.192599 Sep 11 10:51:15.366623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 267/528] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:15 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:16.390212 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:16.390825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:16.396927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:16.397469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:16.397843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:16.398572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:16.399020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:16.399455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:16.678372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:16.688346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6310289f-93fc-4286-94c3-9b164a1518d1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.302257 Sep 11 10:51:16.689028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 262/529] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:16 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:17.723151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:17.724560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:17.739066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:17.739852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:17.740452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:17.741522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:17.742263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:17.744115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:18.108315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:18.117666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-26cf0079-9227-4527-9de8-b0cf3905b7e3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.406018 Sep 11 10:51:18.123797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 268/530] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:17 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:19.143458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:19.144304 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:19.147480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:19.148781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:19.153100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:19.154423 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:19.154932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:19.155748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:19.156235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:19.156939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:19.411995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:19.422576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-97f1ec51-9878-4cdf-965c-06e3d7814465 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.282990 Sep 11 10:51:19.424687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 263/531] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:19 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:20.447390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:20.448603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:20.450761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:20.458119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:20.458975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:20.459675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:20.460643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:20.461300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:20.461952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:20.635258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:20.646529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0efd4b5e-4a42-46ea-8b3b-49fa3a5cf78b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.203729 Sep 11 10:51:20.660521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 269/532] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:20 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:21.670398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:21.671009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:21.674783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:21.695739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:21.696261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:21.699266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:21.700103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:21.704414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:21.704924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:21.897503 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:21.907542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4ae893c4-ba22-469e-856b-c7ee9bcd500f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.241257 Sep 11 10:51:21.908805 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 264/533] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:21 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:22.936231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:22.937667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:22.948169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:22.950662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:22.951450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:22.952920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:22.953865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:22.955654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:23.311826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:23.320123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0ff7dc03-2a58-4bdc-b52a-b9b2b529d2bd tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.391596 Sep 11 10:51:23.322656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 270/534] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:22 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:24.366947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:24.370662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:24.401069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:24.401584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:24.402031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:24.402753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:24.403216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:24.403887 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:24.983397 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:24.995398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6decf68e-0287-420e-ac34-e3961757bd9a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.653450 Sep 11 10:51:24.998554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 265/535] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:24 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:25.971939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646d54e0-29b4-45c0-aa4b-4d540825d887", "name": "network-vif-plugged", "status": "completed", "tag": "e62f0749-ab15-40f3-b785-e90aadfb68ed"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:25.982430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:25.983751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:25.984339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:25.999178 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] Creating event network-vif-plugged:e62f0749-ab15-40f3-b785-e90aadfb68ed for instance 646d54e0-29b4-45c0-aa4b-4d540825d887 on hv-cinder-85646 Sep 11 10:51:26.005562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-847fc033-8d44-4156-82b9-1b63147901a5 req-7a8a9d5a-bb1a-4e1d-aeff-1f2c7a657ce0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038118 Sep 11 10:51:26.007535 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 271/536] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:51:26.021125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:26.021747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:26.029020 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:26.029524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:26.029967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:26.030689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:26.031152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:26.031619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:26.316495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:26.325576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6d15c97f-8994-438f-a2a1-b6e651538173 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.308612 Sep 11 10:51:26.327237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 266/537] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:26 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:27.350440 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:27.351149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:27.358532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:27.359024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:27.359479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:27.360183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:27.360821 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:27.361473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:27.527269 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:27.536204 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-60b7ba52-7315-44f7-a31f-e0e7ab9d5812 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.189999 Sep 11 10:51:27.553331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 272/538] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:27 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:28.559268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:28.560962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:28.571983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:28.572728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:28.573621 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:28.574575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:28.576152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:28.576652 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:28.776177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:28.795917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-42eb2eb4-c93d-4a1f-9d4f-2f7f67622ab4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1265 microversion: 2.1 time: 0.239598 Sep 11 10:51:28.798001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 267/539] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:28 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:29.826995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:29.828406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:29.849085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:29.849580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:29.850018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:29.850794 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:29.851247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:29.851700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:30.026103 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:30.037110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a1a390fd-ff3f-4098-9e94-0ac8294c0886 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1451 microversion: 2.1 time: 0.216838 Sep 11 10:51:30.047996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 273/540] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:29 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1451 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:30.061806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:30.063288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:30.070041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:30.070788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:30.071414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:30.072333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:30.073218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:30.073824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:30.298209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:30.306480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ef8837e4-ad26-43de-8efd-5d4c7b0d0c56 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1451 microversion: 2.1 time: 0.248494 Sep 11 10:51:30.307678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 268/541] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:30 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:32.743372 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646d54e0-29b4-45c0-aa4b-4d540825d887", "tag": "e62f0749-ab15-40f3-b785-e90aadfb68ed"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:32.765997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:32.766486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:32.766917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:32.791297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] Creating event network-changed:e62f0749-ab15-40f3-b785-e90aadfb68ed for instance 646d54e0-29b4-45c0-aa4b-4d540825d887 on hv-cinder-85646 Sep 11 10:51:32.799322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-fdc74c9f-4b7b-49aa-a8de-1ee6e5812b5c req-205d7bbb-357a-4672-84d7-f3c02a6a98c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058153 Sep 11 10:51:32.800001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 274/542] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:36.296513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:36.297111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:36.314972 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:36.315580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:36.316090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:36.316858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:36.317382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:36.317875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:36.345308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a94320b5-a82c-4dbe-8b52-06223d031274 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/ips" status: 200 len: 145 microversion: 2.1 time: 0.054278 Sep 11 10:51:36.345911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 269/543] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:51:36 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:37.430750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:37.431327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:37.442321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:37.442502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:37.448765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:37.455744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:37.456240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:37.456682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:37.459570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=62 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:37.485965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5245415f-9005-46b2-b83d-81a80d1b2ad0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/ips" status: 200 len: 152 microversion: 2.20 time: 0.059792 Sep 11 10:51:37.493573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 275/544] 10.222.0.15 () {60 vars in 1289 bytes} [Sun Sep 11 10:51:37 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:51:38.370777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8db2ca1f-7db5-45ae-9f5f-348e2dd87c5e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'create', calling method: .version_select at 0x7f75a02218b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1529275444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4j1xkJYuIqb0qzCRh80JSbMevMdGxziRdvNje2Cg3oslztkR/fggNUwe/xpXIQbw3TUphRLAMAH/4XPJQc1SbTkl7ky56LbWWEJvP4Sg1rcN7uSAX8S1v2hP70fsPJfg=="}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:38.387294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-8db2ca1f-7db5-45ae-9f5f-348e2dd87c5e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Getting quotas for project 73cbd4a12d444b0ba5d4c37d12f2ea49. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:51:38.392024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-8db2ca1f-7db5-45ae-9f5f-348e2dd87c5e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Getting quotas for user 8902fe9b4ce54ad398422722101a947a and project 73cbd4a12d444b0ba5d4c37d12f2ea49. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:51:38.419783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8db2ca1f-7db5-45ae-9f5f-348e2dd87c5e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052755 Sep 11 10:51:38.422940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 270/545] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:51:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:38.521822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2111495397", "imageRef": "5eb59eca-c1a8-453f-ab66-9cf002c4e7f6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1529275444", "networks": [{"uuid": "d1cb37a8-473c-4de1-a107-93fb4af25406"}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:38.530116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5401c9b-bd3d-4850-a02c-bb4064be5275"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:38.532702 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:38.539393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:38.539932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:38.540381 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:38.541087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:38.541547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:38.541975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:38.735539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] validate_networks() for [('d1cb37a8-473c-4de1-a107-93fb4af25406', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:51:38.949994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-470ea56a-25ef-45ad-badc-229565897334 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423969 Sep 11 10:51:38.951663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 271/546] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:51:38 2022] POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:51:39.157790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:51:39.158217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:51:39.158724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:51:39.159136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:51:39.159568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:51:39.169739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:39.170288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:39.170917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:39.171727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:39.172365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:39.172816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:39.190000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Getting quotas for project 73cbd4a12d444b0ba5d4c37d12f2ea49. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:51:39.194430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Getting quotas for user 8902fe9b4ce54ad398422722101a947a and project 73cbd4a12d444b0ba5d4c37d12f2ea49. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:51:39.206576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:51:39.208852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb59eca-c1a8-453f-ab66-9cf002c4e7f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:51:39.257411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c01275c2-e7d9-4d8e-8ce7-607a13ef0c74 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739271 Sep 11 10:51:39.258205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 276/547] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:51:39.270120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e5894936-17c2-48cc-8b62-2f2f8cd62796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:39.270817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e5894936-17c2-48cc-8b62-2f2f8cd62796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:39.334670 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e5894936-17c2-48cc-8b62-2f2f8cd62796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:39.342275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e5894936-17c2-48cc-8b62-2f2f8cd62796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1259 microversion: 2.1 time: 0.076789 Sep 11 10:51:39.342917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 272/548] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:39 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:40.367265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:40.367917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:40.369796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:40.375973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.376459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.376894 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:40.377586 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.378039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.378577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:40.442222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:40.450080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-39a7c0f4-ed41-477b-ba3e-2018a793b183 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1311 microversion: 2.1 time: 0.086586 Sep 11 10:51:40.450649 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 277/549] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:40 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:40.560479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:40.561056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:40.568802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.569320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.569830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:40.570615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.571370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.571654 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:40.595460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lazy-loading 'flavor' on Instance uuid 0b830749-7cd2-44a9-8809-d6ff81ec2da1 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:51:40.814613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e6553aca-76b3-4c12-8f82-de80586804bf tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/action" status: 202 len: 0 microversion: 2.20 time: 0.257785 Sep 11 10:51:40.815475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 273/550] 10.222.0.15 () {62 vars in 1319 bytes} [Sun Sep 11 10:51:40 2022] POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:51:40.824238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:40.825662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:40.832925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.833983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.834757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:40.835863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:40.836549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:40.837273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:41.052115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:41.060599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:41.062069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:41.063231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-66e35494-8d5f-4d41-ba7a-406892c5d71a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.243423 Sep 11 10:51:41.063816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 278/551] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:40 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:51:41.475672 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:41.476384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:41.484795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:41.485292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:41.485735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:41.486444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:41.486903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:41.487334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:41.557746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:41.566523 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-76ef5c60-8c1d-47e0-a4d5-293db8ea5b4d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1317 microversion: 2.1 time: 0.095810 Sep 11 10:51:41.567466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 274/552] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:41 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:42.088933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:42.089537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:42.096391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:42.096877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:42.097309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:42.098188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:42.098817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:42.099289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:42.240379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:42.248392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:42.249846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:42.250992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-816e009e-0d78-4485-8f18-1fa62840b438 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.165955 Sep 11 10:51:42.251569 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 279/553] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:42 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:42.591061 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:42.591903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:42.598158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:42.598644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:42.599079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:42.599798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:42.600255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:42.600678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:42.746845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:42.754691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0adbc9e8-3dec-45e1-95c6-9c69f77c2f48 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.167933 Sep 11 10:51:42.755530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 275/554] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:42 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:51:43.276380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:43.277274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:43.306847 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:43.307670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:43.308222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:43.309194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:43.309767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:43.310326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:43.467159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:43.475709 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:43.477082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:43.478273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bf0f2b5d-6bbd-4ec5-bc01-88993321253d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.206684 Sep 11 10:51:43.478828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 280/555] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:43 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:43.778155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:43.779046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:43.786115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:43.786596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:43.787025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:43.787750 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:43.788202 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:43.788618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:43.925732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:43.933350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-920e9f22-30bf-42e7-a034-ed41dcc201e5 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.159073 Sep 11 10:51:43.933914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 276/556] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:43 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:44.505902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:44.506663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:44.514685 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:44.515188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:44.515649 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:44.516367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:44.516839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:44.517258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:44.665701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:44.674206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:44.675655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:44.676809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9a543c83-c22e-48a3-9e1a-444c57d575e2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.175680 Sep 11 10:51:44.677335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 281/557] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:44 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:44.956967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:44.957578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:44.963923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:44.964404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:44.964840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:44.966254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:44.966884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:44.967311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:44.969937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:45.101269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:45.109950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1a2a1c43-0624-4c12-aba9-e727013fee0f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.156743 Sep 11 10:51:45.110983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 277/558] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:44 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:45.702094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:45.702699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:45.708678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:45.709160 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:45.709597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:45.710287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:45.710740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:45.711166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:45.840224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:45.848751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:45.850164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:45.851307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ea8e3ac-4afd-48f5-bf92-1145da4a2d69 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.153234 Sep 11 10:51:45.851900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 282/559] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:45 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:46.144849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:46.146484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:46.153640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:46.154127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:46.154585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:46.155292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:46.155774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:46.156221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:46.297897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:46.306047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6e8d9e3f-c865-4f5b-a759-f1e39aae361e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.166681 Sep 11 10:51:46.306616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 278/560] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:46 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:46.878189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:46.878798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:46.884746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:46.885233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:46.885673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:46.886367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:46.886830 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:46.887764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:47.020180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:47.028802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:47.030225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:47.031370 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7b84815a-702b-4e06-85aa-c821b334b769 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.157104 Sep 11 10:51:47.031954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 283/561] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:46 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:47.329285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:47.329896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:47.336473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:47.336966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:47.337401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:47.338103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:47.338557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:47.338979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:47.468705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:47.476641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-67f81f66-e97d-4628-a655-cac3306a054e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.151829 Sep 11 10:51:47.477206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 279/562] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:47 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:48.225859 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:48.227209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:48.234579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:48.235291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:48.235762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:48.236470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:48.237069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:48.237533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:48.372704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:48.380727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:48.382151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:48.383289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4bdf06be-5c0c-4d6f-a340-84ce799ca942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.330864 Sep 11 10:51:48.383875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 284/563] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:48 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:48.502539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:48.503207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:48.511069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:48.512014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:48.513201 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:48.514009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:48.514464 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:48.515088 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:48.655812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:48.663619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-76c56ee9-1e84-4ca1-bcf8-d07bd1ca69bb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.164987 Sep 11 10:51:48.664182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 280/564] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:48 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:49.409002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:49.409639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:49.411718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.412414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.423282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:49.423802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:49.424238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:49.424940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:49.425415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:49.425930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:49.560070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:49.568256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:49.569629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:49.570777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c4736949-ac95-4359-a87b-1d0f1aa6cdb8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.165842 Sep 11 10:51:49.571326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 285/565] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:49 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:49.687548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:49.688142 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:49.690202 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.695820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:49.696306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:49.696743 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:49.697432 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:49.697890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:49.698312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:49.836808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:49.861124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1fa48c5e-1529-470c-9341-8b1590f096c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.177277 Sep 11 10:51:49.861716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 281/566] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:49 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:50.597272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:50.597899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:50.606839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:50.607742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:50.608794 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:50.609622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:50.610031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:50.610518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:50.749791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:50.759346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:50.761193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:50.763560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-29344021-96e3-4b69-8e26-64465cb2b412 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.170317 Sep 11 10:51:50.764424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 286/567] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:50 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:50.885444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:50.886060 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:50.892926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:50.893433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:50.893867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:50.894558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:50.895008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:50.895483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:51.047727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:51.055347 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3ff111d7-2c4f-4b05-b423-18a03b9ebdf7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.173840 Sep 11 10:51:51.055945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 282/568] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:50 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:51.789116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:51.789775 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:51.797234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:51.797707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:51.798132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:51.798809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:51.799252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:51.799701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:51.942554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:51.951759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:51.953009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:51.954353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9791b58a-056b-4715-88d9-c030d3d98c11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.169121 Sep 11 10:51:51.955156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 287/569] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:51 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:52.078996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:52.079661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:52.082002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:52.087882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:52.088375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:52.088806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:52.089511 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:52.089968 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:52.090933 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:52.233277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:52.241408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-41781c5d-b14a-4086-a64e-d945e634652c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.167042 Sep 11 10:51:52.241979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 283/570] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:52 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:52.984030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:52.984766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:52.993943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:52.994558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:52.995066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:52.995867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:52.996526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:52.997082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:53.140516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:53.149280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:53.150717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:53.151916 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8ace38fd-a442-4ef3-986e-e3ae1ca31165 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.173564 Sep 11 10:51:53.152470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 288/571] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:52 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:53.266011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:53.266625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:53.273505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:53.273992 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:53.274427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:53.275357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:53.276027 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:53.276643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:53.415796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:53.423361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e3263a32-66f3-49ac-81ad-a4c402de5ee4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.162098 Sep 11 10:51:53.423945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 284/572] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:53 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:54.180945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:54.181581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:54.187804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:54.188293 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:54.188756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:54.189443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:54.189929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:54.190352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:54.321706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:54.329919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:54.331375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:54.332566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fc8178f3-3e0c-4a3a-891b-d4e3830f7913 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.155528 Sep 11 10:51:54.333145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 289/573] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:54 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:54.447034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:54.447736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:54.454728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:54.455203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:54.455658 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:54.456345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:54.456796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:54.457215 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:54.589900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:54.598794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a4c7ea6c-f41f-46be-82e3-a0571a88ad47 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.155797 Sep 11 10:51:54.599358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 285/574] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:54 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:55.357898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:55.358750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:55.364609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:55.365082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:55.365507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:55.366181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:55.366625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:55.367039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:55.493924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:55.502571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:55.504024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:55.505173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-535786ee-8be1-4721-b006-f074c423560a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.151427 Sep 11 10:51:55.505730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 290/575] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:55 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:51:55.622578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:55.623281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:55.629608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:55.630082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:55.630509 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:55.631210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:55.631679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:55.632102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:55.760276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:55.768488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6d63bf77-2fc3-4f46-a2a7-f7692e283070 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.150556 Sep 11 10:51:55.769049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 286/576] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:55 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:56.530789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:56.531399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:56.540013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:56.540506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:56.540961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:56.541631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:56.542084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:56.542508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:56.674192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:56.682150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:56.683603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:56.685389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7979659a-2e66-4a5c-b5df-646292f904df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.158498 Sep 11 10:51:56.685940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 291/577] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:56 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:56.796714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:56.797249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:56.803680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:56.804169 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:56.804604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:56.805298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:56.805754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:56.806177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:56.935874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:56.943611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0c4cc9d8-58ab-4f47-8322-bc9171b39b26 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.151704 Sep 11 10:51:56.944193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 287/578] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:56 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:51:57.710427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:57.711032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:57.717842 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:57.718864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:57.719306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:57.720037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:57.720493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:57.720920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:57.967631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:57.968199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:57.974773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:57.975266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:57.975519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:57.975734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:57.976623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:57.977240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:57.977824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:57.984023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:57.993966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:57.995525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:57.997414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c7d2b220-fb7a-4051-8546-3a9d6a948a35 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.291058 Sep 11 10:51:57.998042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 292/579] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:57 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:58.177698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:58.188748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-79df14b7-d9e5-4298-8036-85e53453a7d7 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.226363 Sep 11 10:51:58.189354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 288/580] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:57 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:51:58.478215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:51:58.488935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:58.489406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:58.489844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:58.501886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] Creating event network-changed:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:51:58.506794 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-7f5b0ab1-cc18-4ed6-b6a4-0c5b3726f452 req-ea04cc13-9569-46ad-945c-a022f7146d15 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 Sep 11 10:51:58.507384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 293/581] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:51:59.022180 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:59.022791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:59.029498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:59.029991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:59.030438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:59.031132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:59.031624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:59.032057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:59.160888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:59.169127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:59.170557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:59.171861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b9ab17e1-0f34-4981-9545-876dc84666c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.153516 Sep 11 10:51:59.172419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 289/582] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:51:59 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:51:59.214259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:51:59.216028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:51:59.223759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:59.224262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:59.224699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:59.225479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:51:59.226012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:51:59.226439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:51:59.374300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:51:59.382141 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2e949b11-ce6f-4f63-9d0b-6c7fd6314e8d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.173185 Sep 11 10:51:59.382703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 294/583] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:51:59 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:00.197555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:00.198227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:00.205326 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.205817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.206263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.206962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.207441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.207876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.404249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:00.406620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:00.407342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:00.412690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:00.413776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.414324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:00.414482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.414867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.415597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.415706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b52a8110-f108-4680-91f0-db21f9d18a15 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.222081 Sep 11 10:52:00.416053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.416411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 290/584] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:00 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:00.416543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.608732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:00.614160 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:00.615289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.615742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.616325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.622694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9e04bd4d-7379-4608-bb38-f1747d9edace tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.219889 Sep 11 10:52:00.623522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 295/585] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:00 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:00.677224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Going to try to stop instance {{(pid=137534) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 10:52:00.720863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2ec61a8e-e589-4df6-8e48-fa37968c4113 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action" status: 202 len: 0 microversion: 2.1 time: 0.116617 Sep 11 10:52:00.721798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 291/586] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:52:00 2022] POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 10:52:00.730075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:00.731130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:00.737474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.737955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.738561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.739414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:00.739993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:00.740566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:00.868948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:00.877905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8354addc-2d3c-4c42-adab-ebed9ff4e541 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.151735 Sep 11 10:52:00.878642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 296/587] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:00 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:01.443314 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:01.444052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:01.450583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.451062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.451592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:01.452459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.453159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.453772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:01.589291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:01.592529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:01.601806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:01.603231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:01.604412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9e7c8ecd-73a5-47f1-a829-428532a65cd0 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.165895 Sep 11 10:52:01.604964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 292/588] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:01 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:01.645703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:01.646356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:01.652819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.653438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.653955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:01.654687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.655147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.655596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:01.788713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:01.797351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9cedcb4c-a4c7-4dde-a8d8-f4dcd12331b8 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.155425 Sep 11 10:52:01.797940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 297/589] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:01 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:01.902100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:01.902862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:01.909301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.909765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.910204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:01.910895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:01.911370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:01.911802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:02.050178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:02.058520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2277b478-793c-4f69-af08-f5fd9b8ae549 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.160802 Sep 11 10:52:02.059654 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 293/590] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:01 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:02.631796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:02.632313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:02.638790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:02.639262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:02.639728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:02.640405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:02.640854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:02.641274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:02.768302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:02.777089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:02.779816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:02.780979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-be516cf9-336a-4adc-8872-b60779a90720 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.153203 Sep 11 10:52:02.781545 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 298/591] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:02 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:02.820312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:02.820954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:02.827636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:02.828121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:02.828561 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:02.829253 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:02.829712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:02.830137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:02.956109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:02.964154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4b9d3c5c-120b-40df-8bfe-5f7f99de2366 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.147628 Sep 11 10:52:02.964840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 294/592] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:02 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:03.082580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:03.083185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:03.089092 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.089575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.090519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.091207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.091691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.092120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.438688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:03.446921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-509decf8-2218-43aa-b618-f9894b2aa6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.368310 Sep 11 10:52:03.447499 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 299/593] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:03 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:03.810819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:03.811478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:03.817359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.817841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.818273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.818959 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.819404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.819841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.861407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "name": "network-vif-plugged", "status": "completed", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:03.877187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.877655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.878097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.895697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] Creating event network-vif-plugged:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:52:03.900864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-10152b6b-6760-4440-b73b-de3533a99fdf req-f5ac53d0-3192-4996-82d5-07ad96bcf2f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043265 Sep 11 10:52:03.901746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 300/594] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:03.955682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:03.963937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:03.965866 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:03.967045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-071d4f7d-0c82-43f0-911f-96c40ccc98e5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.161120 Sep 11 10:52:03.967626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 295/595] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:03 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:03.988401 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:03.989285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:03.995801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.996999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.997470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:03.998262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:03.998724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:03.999151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:04.130321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:04.138836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3637ff42-a693-4e9d-bbb2-3178cba699d4 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.154019 Sep 11 10:52:04.138836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 301/596] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:03 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:04.475692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:04.476311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:04.482903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:04.483684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:04.484127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:04.484821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:04.485282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:04.485709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:04.648101 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:04.656868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-31ad3da4-0877-4f6f-8933-1e991972e4ab tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.185076 Sep 11 10:52:04.657439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 296/597] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:04 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:05.000078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:05.000691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:05.006615 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.007169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.007692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.008409 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.008906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.009359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.161171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:05.161789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:05.168182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.168671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.169116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.169822 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.170279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.170706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.246432 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:05.255288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:05.256820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:05.258359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d266915e-306e-4a00-af23-c841662b6243 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.263206 Sep 11 10:52:05.259001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 302/598] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:04 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:05.317400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:05.325972 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7713613c-c816-4310-a802-39cfd4e42a88 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.168514 Sep 11 10:52:05.326874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 297/599] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:05 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:05.683590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:05.684080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:05.690242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.690736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.691169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.691921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:05.692374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:05.692882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:05.835086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:05.844479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d50ec4ab-1a57-4942-b2bd-19221e4302b1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.165967 Sep 11 10:52:05.845066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 303/600] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:05 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:06.284674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:06.285184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:06.291755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.292244 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.292682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:06.293656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.294111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.294536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:06.351907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:06.352531 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:06.358759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.359247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.359710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:06.360443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.360902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.361329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:06.462597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:06.472146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:06.473742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:06.475056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f4455d93-2541-41b9-a826-6af7024e5ac4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1744 microversion: 2.20 time: 0.194342 Sep 11 10:52:06.475727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 298/601] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:06 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:06.516934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:06.524497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a4622a34-639c-4fa1-aaf0-c81218de9940 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.176685 Sep 11 10:52:06.525058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 304/602] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:06 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:06.871185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:06.871869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:06.878092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.878606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.879018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:06.879751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:06.880218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:06.880649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:07.024264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:07.032554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8b30f89e-7533-4593-820b-d7cbf8e9d748 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.165940 Sep 11 10:52:07.033114 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 299/603] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:06 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:07.502529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:07.503158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:07.509031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:07.509515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:07.509947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:07.510625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:07.511314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:07.511773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:07.548736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:07.549760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:07.556206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:07.556656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:07.557239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:07.557960 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:07.558930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:07.559348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:07.723619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:07.733814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:07.735406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:07.736606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4583127d-c343-44d8-bb4a-6a3add1a7f9f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.238287 Sep 11 10:52:07.748193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:07.748382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 305/604] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:07 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:07.756135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-05d4bddb-79d1-4f21-ae59-edd5f43ec96e tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.211616 Sep 11 10:52:07.756842 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 300/605] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:07 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:08.057246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:08.058170 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:08.065055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.065954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.066551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.067753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.068485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.069063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.224441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:08.236132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b96c7128-478c-4158-b163-6c0af68511dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.183010 Sep 11 10:52:08.241945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "name": "network-vif-plugged", "status": "completed", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:08.253976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 306/606] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:08 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:08.259776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.260479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.261048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.278188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] Creating event network-vif-plugged:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:52:08.283914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-ea5ab341-09e4-4e0d-978b-01ffcde93b12 req-4b458793-a659-4bfa-b822-56ded8e70b13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045761 Sep 11 10:52:08.285007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 301/607] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:08.764779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:08.766240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:08.772595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.773346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.774120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.775037 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.775810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.776546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.781434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:08.782149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:08.789225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.789840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.790228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:08.791151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:08.793602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:08.794789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:09.036397 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:09.037556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:09.049078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:09.050655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:09.052080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cd3a3dd2-e3df-401f-b3eb-68de09db460f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.292080 Sep 11 10:52:09.054601 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6671b7d2-8aef-4be0-80b6-ca7bb1bb2c0b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.278945 Sep 11 10:52:09.067449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 302/608] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:08 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:09.067643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 307/609] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:08 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:09.260828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:09.261471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:09.267704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:09.268200 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:09.268640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:09.269340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:09.269797 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:09.270231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:09.427876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:09.436619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-627c0bfa-dc9d-4a9a-9c89-60478b36e6bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.179604 Sep 11 10:52:09.437195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 303/610] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:09 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:10.078476 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:10.079193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:10.082787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:10.083838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:10.086810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.087371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.087906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.088703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.089234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.089958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.091173 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.091705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.095475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.096340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.096837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.097271 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.316782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:10.319407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:10.326061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:10.327564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:10.328973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f07c539e-6d36-4011-a06f-a68ca16bf4b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.254882 Sep 11 10:52:10.329136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5f3e8822-695a-4e6c-b2c8-6d3c4faa8a54 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1359 microversion: 2.1 time: 0.251114 Sep 11 10:52:10.329824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 304/612] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:10 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:10.329983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 308/612] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:10 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:10.460580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:10.461379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:10.470534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.471227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.471694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.472400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:10.472853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:10.473278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:10.640870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:10.649471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1b78f13d-0f61-4213-8cae-a27adad42f30 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.192898 Sep 11 10:52:10.650211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 305/613] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:10 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:11.353734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:11.354599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:11.355339 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:11.356414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:11.358854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=64 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:11.363262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.363793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.364231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.364786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.365018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.365371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.365765 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.365957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.366801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.367738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.368263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.368740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.588366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.596514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d52e4b2e-285f-4121-9783-68f720a066c2 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1550 microversion: 2.1 time: 0.248111 Sep 11 10:52:11.599380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.602888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 309/614] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:11 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1550 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:11.609539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.611289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.613063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bfa03d46-e30f-45f6-9412-dcaf23f7f640 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.262618 Sep 11 10:52:11.625543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:11.626141 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:11.628149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 306/615] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:11 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:11.632631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.633117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.633554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.634243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.634695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.635192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.674755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:11.675614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:11.682331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.682911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.684364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.685154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.685818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.686350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.868817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.872001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:11.877893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.886244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-36aeaeff-5abf-4bfe-aeda-d0d3129cddef tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1550 microversion: 2.1 time: 0.265215 Sep 11 10:52:11.886476 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6f32c48e-c5ba-4aae-8157-880c8b8eb0ef tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.215275 Sep 11 10:52:11.887466 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 310/616] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:11 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1550 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:11.889019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 307/617] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:11 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:11.911849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:11.917326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:11.918202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Searching by: {'deleted': False, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49'} {{(pid=137535) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 10:52:11.924815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.925293 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.925719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:11.926431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:11.926880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:11.927297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.021465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.multi_cell_list [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 10:52:12.134780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-148cfa56-f5e4-4cef-8a44-5c87aaa04529 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226476 Sep 11 10:52:12.136071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 311/618] 10.222.0.15 () {58 vars in 1125 bytes} [Sun Sep 11 10:52:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:12.147589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:12.148275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:12.157158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.157626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.158063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.158742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.159189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.159642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.302949 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:12.310837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-332795d8-5777-4b85-b200-f83935ed4927 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1550 microversion: 2.1 time: 0.167010 Sep 11 10:52:12.311408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 308/619] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:12 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:12.642869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:12.643657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:12.650194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.650742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.651187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.652313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.653227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.653227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.806028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:12.816230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:12.817799 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:12.819065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-66b9134f-0143-4f25-930c-36f709262819 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.184193 Sep 11 10:52:12.823451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 312/620] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:12 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:12.911733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:12.913105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:12.920412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.921174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.922034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:12.922950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:12.923537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:12.924163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:13.066830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:13.076950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5d3dfb89-a4df-4b43-a885-abf3c214a8dc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.169061 Sep 11 10:52:13.077668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 309/621] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:12 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:13.845593 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:13.846227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:13.855980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:13.856778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:13.857750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:13.858823 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:13.859519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:13.859897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:14.026327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:14.041047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:14.044351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:14.045632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9ad6f6b3-82da-4269-93e9-2cdf25c53329 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.204717 Sep 11 10:52:14.046658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 313/622] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:13 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:14.107502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:14.110749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:14.120258 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:14.120790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:14.121225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:14.122129 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:14.122585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:14.123011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:14.126057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:14.276886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:14.287600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-05e71bcf-1f88-479a-b4a5-c15e914cadf0 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.185659 Sep 11 10:52:14.288472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 310/623] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:14 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:15.009616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "109e7e1b-cb7e-42ba-acb2-e1421edeadb0"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:15.013036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:15.019875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.020608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.021259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.021947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.022397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.022816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.073749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:15.074435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:15.081609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.088964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.090167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.091152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.091739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.092387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.265949 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:15.275656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:15.277348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:15.279362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5021fb77-4822-416d-a2b9-21ce7f9708b9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.209701 Sep 11 10:52:15.281653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 311/624] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:15 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:15.313012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:15.313714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:15.321075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.321875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.322714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.324332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:15.325182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:15.326000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:15.422665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bba53d95-32bb-4c7b-84c9-1e8cd9d03a63 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416908 Sep 11 10:52:15.424201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 314/625] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:52:15 2022] POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:52:15.511928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:15.520405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d44389fe-8a69-4775-bdd0-62f2edda7841 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.211347 Sep 11 10:52:15.521291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 312/626] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:15 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:16.311396 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:16.312127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:16.326617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:16.327273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:16.327792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:16.328616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:16.329163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:16.329662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:16.476157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:16.486103 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:16.487548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:16.488705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-72b9c365-5e61-4362-ac73-5dd11ece6189 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.183112 Sep 11 10:52:16.489250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 315/627] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:16 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:16.544883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:16.546193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:16.555130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:16.557347 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:16.558952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:16.560097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:16.565543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:16.565989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:16.727329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:16.737011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-159eb2d1-0563-4047-9348-9e75adee7ef9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.196710 Sep 11 10:52:16.738157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 313/628] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:16 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:17.514269 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:17.515181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:17.525088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:17.525727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:17.526167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:17.526880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:17.527339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:17.527996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:17.688697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:17.698187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:17.718474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:17.718474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2f24691e-e1be-4a00-b126-5d24f595a60d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.194023 Sep 11 10:52:17.718474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 316/629] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:17 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:17.761614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:17.762514 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:17.768757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:17.769254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:17.769678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:17.770597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:17.771055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:17.771563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:17.932599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:17.942543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-10ee114c-ad96-48b9-b4b4-29793d67a69a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.184963 Sep 11 10:52:17.943642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 314/630] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:17 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:18.729507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:18.730954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:18.737605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:18.738091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:18.738523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:18.739216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:18.739697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:18.740127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:18.874207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:18.882162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:18.883681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:18.884829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6523b67a-96e8-4d6f-b439-d3deb61a004a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1739 microversion: 2.20 time: 0.159159 Sep 11 10:52:18.885383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 317/631] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:18 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:18.968391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:18.969023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:18.975721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:18.976169 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:18.976605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:18.977339 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:18.977817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:18.978247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:19.116323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:19.125074 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4d149aa6-aed9-4f32-a13d-a842f5108bce tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.160998 Sep 11 10:52:19.125631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 315/632] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:18 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:19.910547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:19.911148 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:19.917948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:19.918737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:19.919196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:19.919906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:19.920350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:19.920796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:20.126103 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:20.133994 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:20.135397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:20.136897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-41df5e1d-4fbf-4aa2-badd-25d4cca559dc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1721 microversion: 2.20 time: 0.229903 Sep 11 10:52:20.137404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 318/633] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:19 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:20.148492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:20.149033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:20.156151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:20.156635 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:20.157074 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:20.157770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:20.158213 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:20.158631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:20.291230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:20.300329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-705f3b72-c799-4cb6-945c-235ca7bcefb3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.155693 Sep 11 10:52:20.300888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 316/634] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:20 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:21.162163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:21.162682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:21.169284 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:21.169757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:21.170182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:21.170854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:21.171297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:21.171742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:21.304769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:21.313949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:21.315224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:21.316396 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5e6eb4a7-950c-437e-8a0c-b00c5c94e6dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1721 microversion: 2.20 time: 0.158234 Sep 11 10:52:21.317180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 319/635] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:21 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:21.323347 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:21.324047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:21.330524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:21.331063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:21.331528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:21.332223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:21.332711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:21.333140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:21.461648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:21.470043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fddf5acf-69fb-4db6-9620-961791c32e76 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.150480 Sep 11 10:52:21.470616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 317/636] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:21 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:22.341739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:22.342347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:22.344383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:22.350640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:22.351119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:22.351587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:22.352274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:22.352724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:22.353143 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:22.485285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:22.493567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:22.494467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:22.495028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:22.496088 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:22.497056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-33e85326-5353-41a8-a2ef-1ad45810474a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1721 microversion: 2.20 time: 0.159872 Sep 11 10:52:22.497828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 320/637] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:22 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:22.499977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=70 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:22.503867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:22.504370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:22.504792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:22.505491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:22.505946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:22.506368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:22.633202 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:22.641395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2fa44c36-708c-4437-ab34-739ac5ac4730 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.151034 Sep 11 10:52:22.641952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 318/638] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:22 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:23.524262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:23.525071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:23.533676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.534249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.534911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.535609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.536173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.536669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.665341 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:23.667332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:23.674541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.675126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.675322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:23.675637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.676535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.676995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.677576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.685202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:23.688126 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:23.689291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cf19d3af-bc2a-44fe-bafd-4e44aac5fd19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1724 microversion: 2.20 time: 0.170758 Sep 11 10:52:23.689837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 321/639] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:23 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:23.717022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da859933-d37d-4d09-9ca8-eb43e347f5cd"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:23.721152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:23.732459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.733494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.734172 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.734882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:23.735526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:23.736038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:23.825287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:23.834279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dd4d6172-3f0a-4ac4-9cc4-efa03a059d86 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.172804 Sep 11 10:52:23.834781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 319/640] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:23 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:24.038413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "name": "network-vif-unplugged", "status": "completed", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:24.062457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5be2ecb6-ccb8-4754-b7dc-94288cf3315c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350293 Sep 11 10:52:24.063357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 322/641] 10.222.0.15 () {62 vars in 1364 bytes} [Sun Sep 11 10:52:23 2022] POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments => generated 188 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 10:52:24.075158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.075674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.076105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.088115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] Creating event network-vif-unplugged:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:52:24.095274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-5713d59c-f384-41f7-b0a5-cd143e2e621c req-048b980e-9618-4324-a6d4-905c6fe72344 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063247 Sep 11 10:52:24.096544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 320/642] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:52:24.200847 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:24.201428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:24.207897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.208379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.208814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.209503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.209955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.210376 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.215088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:24.265928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:24.266616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:24.272679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.273162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.273589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.274371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.275004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.275459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.301451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137535) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 10:52:24.372733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5d67a638-ef88-4e03-a46c-f87b382f96b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/action" status: 202 len: 0 microversion: 2.20 time: 0.176283 Sep 11 10:52:24.376290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 323/643] 10.222.0.15 () {62 vars in 1319 bytes} [Sun Sep 11 10:52:24 2022] POST /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:52:24.381773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:24.382428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:24.388945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.389436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.389918 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.390567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.391019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.391461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.452521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:24.460891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d9279d62-f2c0-44c0-abfe-8547eb8a247b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1596 microversion: 2.1 time: 0.199514 Sep 11 10:52:24.461557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 321/644] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:24 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1596 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:24.552077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:24.561622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:24.563112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:24.564281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-237f94fc-e678-45df-87d7-1ddad1946db7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1750 microversion: 2.20 time: 0.186575 Sep 11 10:52:24.565506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 324/645] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:24 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:24.858688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:24.859294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:24.866217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.866976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.867408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:24.868319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:24.868775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:24.869196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:25.086493 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:25.095497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1d9bbc6f-acf8-45a7-8f4c-1e067c8f0deb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.241377 Sep 11 10:52:25.096703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 322/646] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:24 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:25.591683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:25.592429 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:25.600961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:25.601566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:25.602571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:25.603353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:25.603993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:25.604481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:25.876478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:25.885351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:25.887135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:25.888350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-25c91d33-0d69-43da-b1fd-8672ed62b084 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1752 microversion: 2.20 time: 0.301952 Sep 11 10:52:25.889414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 325/647] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:25 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1752 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:26.120094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:26.121072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:26.127050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:26.127498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:26.127967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:26.128662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:26.129113 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:26.129533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:26.396895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:26.405544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a1884405-55e6-4b96-aaa2-d500a25792fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.289265 Sep 11 10:52:26.406328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 323/648] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:26 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:26.818522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:26.832200 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:26.833152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:26.833727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:26.848220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] Creating event network-changed:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:52:26.855259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-a0ab32b2-4be6-4c3f-ac45-1a26285ed469 req-9f74b202-ee08-4f06-87b1-93116e5f88ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121931 Sep 11 10:52:26.856969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 326/649] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:26.924426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:26.925781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:26.946593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:26.947230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:26.947924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:26.948799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:26.949356 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:26.949902 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:27.234271 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:27.249542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:27.251302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:27.252531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5b4fc101-dc0e-4233-bba0-859adb95e303 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.341271 Sep 11 10:52:27.253083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 324/650] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:26 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:27.431046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:27.434703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:27.441134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:27.441734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:27.442389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:27.443177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:27.443810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:27.444452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:27.783624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:27.804096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8b8d4c8e-19bf-4d55-aec5-c5da6f3dc21e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.377045 Sep 11 10:52:27.805393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 327/651] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:27 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:27.980694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-181097226"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:27.981946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:27.989084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:27.989574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:27.990011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:27.990744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:27.991266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:27.991720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:28.278899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:28.279589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:28.286100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:28.286590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:28.287012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:28.287743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:28.288188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:28.288606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:28.532743 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.network.security_group_api [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Adding security group 496e2c63-8576-4bc2-8d55-d21d1012bfb8 to port 2a7049ea-9e06-4c35-a607-a369f675a987 Sep 11 10:52:28.737721 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:28.747204 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:28.748662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:28.749813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96509ad1-8288-4f9b-8ce7-ab10f8c382d3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.475289 Sep 11 10:52:28.750365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 328/652] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:28 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:28.830087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:28.830686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:28.837152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:28.837626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:28.838060 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:28.838743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:28.840182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:28.840769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.106524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:29.116180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1f28072f-a743-42b5-add3-c35d10068d3d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.290147 Sep 11 10:52:29.117049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 329/653] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:28 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:29.149786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-44c61b79-04b0-456e-88df-06f257e4f53b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action" status: 202 len: 0 microversion: 2.1 time: 1.173622 Sep 11 10:52:29.154026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 325/654] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:52:27 2022] POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:52:29.158819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:29.159444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:29.161125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:29.165282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:29.165770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:29.166200 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.166900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:29.167953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:29.168380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.171259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:29.171776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:29.172209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.183786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] Creating event network-changed:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:52:29.189094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-3dbba65a-46d2-4a75-a119-d92367a9f23e req-bcafaead-2407-4399-8bfd-3bc61e7cadab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031655 Sep 11 10:52:29.189704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 326/655] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:29.359212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:29.367742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-77e5d4c0-9b41-4cdc-9829-6fbb3ab7879a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1761 microversion: 2.1 time: 0.212486 Sep 11 10:52:29.368248 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 330/656] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:29 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1761 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:29.777279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:29.778154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:29.788431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:29.794899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:29.796062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.797445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:29.798138 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:29.798781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:29.985897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:29.995945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:29.997399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:29.998561 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7be11547-a92e-4efe-b4a5-98ca7e1af07f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.226781 Sep 11 10:52:29.999274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 327/657] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:29 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:30.141307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:30.142023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:30.148596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:30.149083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:30.149519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:30.150209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:30.150662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:30.151122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:30.295003 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:30.303388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-88348b3b-a7f4-4307-9a56-a68cda79a23a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.165946 Sep 11 10:52:30.304065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 331/658] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:30 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:31.025856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:31.026548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:31.034034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.034538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.034980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:31.035713 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.036175 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.036606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:31.052165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:31.174079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:31.183404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:31.184906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:31.186079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2592786c-e215-41da-ba35-ff6b5a8b024d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.164363 Sep 11 10:52:31.186635 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 328/659] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:31 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:31.327333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:31.328302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:31.335124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.335753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.336270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:31.337042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.337564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.338055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:31.477350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:31.486868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ee3fc889-5f4f-40c5-80b3-e082434cbab7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.164591 Sep 11 10:52:31.488078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 332/660] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:31 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:31.587801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b096b920-7236-48d1-a00d-b4388918d616"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:31.590515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:31.596633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.597190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.597626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:31.598265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:31.598721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:31.599160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:32.212386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:32.212991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:32.219557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:32.220113 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:32.220570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:32.221391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:32.221851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:32.222278 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:32.367208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:32.377914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:32.379337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:32.380668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bcc0851e-dcf5-4e75-b8a7-b244669844c8 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.172197 Sep 11 10:52:32.381230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 333/661] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:32 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:32.513458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:32.514111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:32.520833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:32.522564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:32.523065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:32.523812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:32.524281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:32.524710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:32.654870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:32.663205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bc4b4512-ad03-48dd-b337-9a0743e74c62 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.154019 Sep 11 10:52:32.663800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 334/662] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:32 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:33.406687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:33.407512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:33.413925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:33.414439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:33.414877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:33.415660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:33.416115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:33.416538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:33.555045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:33.565373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:33.567305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:33.569180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ede4e15-f3c4-4299-b467-85b9a255c744 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.166644 Sep 11 10:52:33.570093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 335/663] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:33 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:33.688327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:33.689011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:33.695001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:33.695534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:33.695976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:33.696719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:33.697177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:33.697602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:33.838807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:33.849398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-754cdfdc-4c85-48ec-b8cd-93c16ce080d5 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.165480 Sep 11 10:52:33.850225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 336/664] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:33 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:34.595136 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:34.595964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:34.602730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:34.603354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:34.604072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:34.604873 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:34.605440 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:34.605999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:34.748581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:34.757367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:34.758804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:34.759966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d627ead4-083e-476f-88d7-b3f2f74da757 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.169772 Sep 11 10:52:34.760510 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 337/665] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:34 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:34.874619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:34.875168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:34.882871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:34.883356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:34.883813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:34.884507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:34.884954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:34.885371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:35.024956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:35.033662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-933d0b8b-7500-4d74-97a5-7a4a51e942fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.163352 Sep 11 10:52:35.034227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 338/666] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:34 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:35.787008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:35.787731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:35.794611 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:35.795196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:35.795964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:35.796787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:35.797518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:35.798095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:35.815695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:35.946483 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:35.955717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:35.957155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:35.958309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-735d50d9-6373-4c0d-b9c5-fa99dc46622b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.175642 Sep 11 10:52:35.958872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 339/667] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:35 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:36.058444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:36.059583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:36.065748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:36.066228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:36.066662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:36.067405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:36.067836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:36.068254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:36.207392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:36.216040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-277c488d-c3a3-4087-8787-4d6789e64133 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.161433 Sep 11 10:52:36.216807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 340/668] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:36 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:36.984140 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:36.984811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:36.991098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:36.991613 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:36.992046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:36.992802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:36.993363 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:36.994019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:37.129590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:37.139143 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:37.140587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:37.141748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e5d5a618-643f-4497-8cd7-e426faeed676 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.162383 Sep 11 10:52:37.144739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 341/669] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:36 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:37.239835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:37.240354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:37.246285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:37.246802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:37.247591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:37.248291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:37.248743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:37.249165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:37.384949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:37.393868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a1fe4076-43d7-4f98-92f7-d735cc46010b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.157861 Sep 11 10:52:37.394912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 342/670] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:37 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:38.170180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:38.172486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:38.181770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:38.182581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:38.182949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:38.183662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:38.184422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:38.185072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:38.331753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:38.340866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:38.342302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:38.343478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-66336b05-7156-4a23-9c5a-087633999ddc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.178363 Sep 11 10:52:38.344042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 343/671] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:38 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:38.420540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:38.421265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:38.427333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:38.427928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:38.428434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:38.429200 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:38.429744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:38.430350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:38.588632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:38.597373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0705f20f-35f0-4a35-aab4-eb77dce3bb6e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.181417 Sep 11 10:52:38.597934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 344/672] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:38 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:39.369648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:39.370324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:39.378410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:39.378902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:39.379334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:39.380062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:39.380515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:39.380965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:39.526522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:39.537078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:39.538796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:39.540209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0633f0ae-68b4-4215-adbc-827a9e13b5a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.174620 Sep 11 10:52:39.541079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 345/673] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:39 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:39.623276 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:39.623828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:39.629731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:39.630208 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:39.630764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:39.631886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:39.631999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:39.632449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:39.766285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:39.774640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d94d15eb-f3bc-4847-87cc-904c9fd2df3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.156218 Sep 11 10:52:39.775602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 346/674] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:39 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:40.567656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:40.568356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:40.575233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:40.575736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:40.576161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:40.576834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:40.577316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:40.577729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:40.711502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:40.720448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:40.721854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:40.722987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0a14ded5-08f6-4204-b066-c83dde0ae172 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.159359 Sep 11 10:52:40.723554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 347/675] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:40 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:40.799441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:40.800048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:40.806274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:40.806778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:40.807352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:40.808114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:40.808650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:40.809869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:40.943864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:40.952168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-62565437-d64a-406e-a973-311273b6435d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.157061 Sep 11 10:52:40.952733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 348/676] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:40 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:41.594040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=23 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:41.671383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=9 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:41.748486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:41.749093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:41.751406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:41.756547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:41.757021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:41.757453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:41.758135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:41.758583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:41.759003 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:41.890537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:41.899056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:41.900514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:41.901670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7ba1da4d-ebd3-46f7-8b6b-7bd9810c1f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.157163 Sep 11 10:52:41.902234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 349/677] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:41 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:41.975193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:41.975820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:41.981597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:41.982070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:41.982498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:41.983438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:41.983895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:41.984310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:42.110913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:42.118951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2419b9de-70c1-427c-be84-e3664e223361 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.147413 Sep 11 10:52:42.119549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 350/678] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:41 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:42.926629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:42.927271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:42.933764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:42.934249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:42.934683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:42.935361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:42.935841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:42.936261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:43.065548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:43.073964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:43.076128 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:43.077271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-61bc9d50-39f5-457e-a402-0bbc6d689331 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.154537 Sep 11 10:52:43.077818 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 351/679] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:42 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:52:43.142249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:43.142778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:43.148472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:43.148950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:43.149386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:43.150070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:43.150517 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:43.150935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:43.276367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:43.284552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f04d015e-b1c8-450e-a621-f7e5af5ed1bc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1724 microversion: 2.1 time: 0.145876 Sep 11 10:52:43.285124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 352/680] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:43 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:43.909100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-02d0279b-5ad8-488f-93a3-bdee6c68c861 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.434053 Sep 11 10:52:43.909709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 329/681] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:52:31 2022] POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 194 bytes in 12436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:44.102285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:44.102789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:44.109708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.110177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.110606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.111281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.111753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.112164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.241368 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:44.250362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:44.251810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:44.253003 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ef01c0a4-9056-4c4e-b342-c77766902bf4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.154773 Sep 11 10:52:44.253587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 353/682] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:44 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:44.310752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:44.311452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:44.317624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.318104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.318532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.319216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.319721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.320144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.454045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:44.462129 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e74de62c-949a-4a78-a1c7-1b1322803fe7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1701 microversion: 2.1 time: 0.156907 Sep 11 10:52:44.462682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 330/683] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:44 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:44.485225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:44.491134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.491656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.492088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.550715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Going to try to start instance {{(pid=137535) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 10:52:44.590558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9316d8f6-9944-4ab5-9814-5409bc818c88 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action" status: 202 len: 0 microversion: 2.1 time: 0.108784 Sep 11 10:52:44.591265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 354/684] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:52:44 2022] POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:52:44.599259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:44.599892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:44.605814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.606300 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.606733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.607415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:44.607888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:44.608577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:44.732346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:44.740917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ae82e9c1-4452-4191-aa95-7b0af332c99b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1710 microversion: 2.1 time: 0.145500 Sep 11 10:52:44.741473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 331/685] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:44 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:45.279374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:45.280109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:45.287929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:45.288418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:45.288851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:45.289638 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:45.290091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:45.290510 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:45.297623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:45.470436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:45.479523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:45.481604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:45.482941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4d5f7930-5cf7-40cd-8b41-8ddd6b2840f9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.208432 Sep 11 10:52:45.483782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 355/686] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:45 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:45.764330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:45.764941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:45.771326 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:45.771872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:45.772309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:45.773009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:45.773463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:45.773892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:45.985951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:45.996949 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f95e5d44-e84e-433d-842d-867fbfb5d737 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1710 microversion: 2.1 time: 0.236568 Sep 11 10:52:45.997530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 332/687] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:45 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1710 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:46.508881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:46.509482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:46.516620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:46.517096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:46.517526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:46.518206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:46.518653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:46.519073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:46.644898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:46.653317 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:46.654748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:46.655930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f73360e6-35ae-43ae-8d22-dfff0dd47544 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.150932 Sep 11 10:52:46.656483 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 356/688] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:46 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:47.031151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:47.031811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:47.038167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:47.038654 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:47.039091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:47.039826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:47.040280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:47.040708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:47.174252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:47.182449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-734a5ccc-2adb-4595-a00c-7a1ae4a45536 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1710 microversion: 2.1 time: 0.156001 Sep 11 10:52:47.183004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 333/689] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:47 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:47.680168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:47.680746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:47.687563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:47.688039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:47.688464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:47.689138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:47.689580 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:47.689996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:47.816307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:47.825568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:47.826992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:47.828172 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ba8a6d7b-f1e9-437e-a0bd-10dcf6e5901d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.151975 Sep 11 10:52:47.828725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 357/690] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:47 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:48.205574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:48.206191 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:48.212643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:48.213127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:48.213593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:48.214281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:48.214736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:48.215279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:48.343310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:48.351374 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a9818607-c27e-4dea-a622-cb877d3a8ce3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1714 microversion: 2.1 time: 0.149581 Sep 11 10:52:48.351961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 334/691] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:48 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:48.854087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:48.854683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:48.862013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:48.862487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:48.862918 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:48.863636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:48.864088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:48.864508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:48.994693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:49.003886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:49.005299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:49.006450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cd9fa096-1689-4834-a595-7d078efa6663 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.156248 Sep 11 10:52:49.007012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 358/692] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:48 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:50.031977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:50.032583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:50.038910 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:50.039394 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:50.039860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:50.040552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:50.041035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:50.041460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:50.166875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:50.176087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:50.178811 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:50.181015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8aae5e73-5dbf-4015-9df3-468ba777c607 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.153281 Sep 11 10:52:50.182028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 335/693] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:50 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:51.207017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:51.207561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:51.213894 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:51.214363 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:51.215536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:51.216227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:51.216665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:51.217227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:51.351945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:51.360915 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:51.362354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:51.363505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b501f2a6-95e8-4dd4-9840-3274ce4a01e4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.160415 Sep 11 10:52:51.364082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 359/694] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:51 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:52.388855 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:52.389451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:52.396223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:52.396710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:52.397145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:52.397841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:52.398290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:52.398711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:52.528449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:52.536829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:52.538258 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:52.539401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f40f9fd6-98a4-4648-912d-4cb3640984eb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.155126 Sep 11 10:52:52.539971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 336/695] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:52 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:53.564051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:53.565630 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:53.572944 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:53.573583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:53.574634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:53.575567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:53.576138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:53.576581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:53.989186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:53.998314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:53.999771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:54.000941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6dbf095f-c3d0-434f-9b98-4b4eabc6ad74 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.441010 Sep 11 10:52:54.001493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 360/696] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:53 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:54.622176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:54.624463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:54.630746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:54.631237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:54.631710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:54.632414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:54.632869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:54.633299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:54.656429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'flavor' on Instance uuid 153cc7c6-3af0-42a2-a57a-93a485f4905b {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:52:54.781316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ac59e73c-ba48-495b-aa68-b33f1a415e55 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/action" status: 200 len: 32 microversion: 2.1 time: 0.163489 Sep 11 10:52:54.782100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 337/697] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:52:54 2022] POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:52:54.791360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:54.792490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:54.799928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:54.800594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:54.801138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:54.801944 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:54.802394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:54.802812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:54.979236 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:54.989072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6aa8fc6c-8fda-49d1-8f08-02facc3916c0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.201448 Sep 11 10:52:54.999838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 361/698] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:54 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:55.026933 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:55.028224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:55.036143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:55.036640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:55.037284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:55.038203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:55.038820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:55.039416 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:55.288323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:55.298671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:55.300382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:55.301542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-eb3dc6a7-dbd3-4af2-bc59-67fe566ed25c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.279084 Sep 11 10:52:55.302632 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 338/699] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:55 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:56.013182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:56.013793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:56.020294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:56.020776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:56.021215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:56.021905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:56.022357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:56.022780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:56.149731 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:56.158620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0919dd52-1c6e-4db1-b30f-63ccb90bcec9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.149400 Sep 11 10:52:56.159175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 362/700] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:56 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:56.328209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:56.328819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:56.335146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:56.335679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:56.336121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:56.336813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:56.337270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:56.337698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:56.474607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:56.484077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:56.485510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:56.486681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d5e0d945-981b-4f41-bee3-bfca7789047b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.162458 Sep 11 10:52:56.487248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 339/701] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:56 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:56.634183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "name": "network-vif-plugged", "status": "completed", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:52:56.644537 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:56.645004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:56.645425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:56.656809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] Creating event network-vif-plugged:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:52:56.661703 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-7a940c1b-9429-4b9e-ab9d-8fb97d33edda req-0bacb05b-3648-49fe-937a-7965074e5dd6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085175 Sep 11 10:52:56.662336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 363/702] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:52:57.182089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:57.182767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:57.189580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:57.190066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:57.190508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:57.191227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:57.191718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:57.192153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:57.327327 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:57.336246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-35cf6e2b-09f1-4b3b-b949-06740aa05922 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.158026 Sep 11 10:52:57.336850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 340/703] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:57 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:57.513410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:57.514019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:57.520191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:57.520665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:57.521097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:57.521808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:57.522258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:57.522676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:57.653540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:57.662005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:57.663414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:57.664565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e1dc9e8e-573f-48ca-b39f-1e18f4ee279b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.156407 Sep 11 10:52:57.665116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 364/704] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:57 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:58.360515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:58.361117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:58.367529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:58.368010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:58.368441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:58.369126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:58.369575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:58.370023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:58.497803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:58.505828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b30cab08-6836-4e7b-8ad0-df5ae02ccfd4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.150386 Sep 11 10:52:58.506390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 341/705] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:58 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:52:58.689560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:58.690097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:58.696151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:58.696626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:58.697053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:58.697727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:58.698166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:58.698577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:58.830518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:58.839024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:58.840618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:58.841757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fe2c6457-0329-4ad7-805f-5bb8b234ca38 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.156100 Sep 11 10:52:58.842308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 365/706] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:58 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:52:59.530211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:59.530814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:59.537307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:59.537787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:59.538217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:59.538898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:59.539345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:59.539786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:59.669476 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:52:59.677505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0fe18bb2-d008-43b6-93a1-5f6ed68d1771 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152180 Sep 11 10:52:59.678067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 342/707] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:52:59 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:52:59.867673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:52:59.868329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:52:59.875260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:59.875770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:59.876207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:52:59.876895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:52:59.877342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:52:59.877769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:00.008527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:00.017598 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:00.019028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:00.020268 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8efcf2d1-0e6c-4d40-a0e1-aefbbe97734d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1808 microversion: 2.20 time: 0.156514 Sep 11 10:53:00.020825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 366/708] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:52:59 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:53:00.701644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:00.702264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:00.708786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:00.709275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:00.709721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:00.710419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:00.710878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:00.711302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:00.715505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:00.844220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:00.852494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4a398321-b199-4954-a630-c39605911944 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.155305 Sep 11 10:53:00.853099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 343/709] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:00 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:01.046161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:01.046761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:01.053467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:01.053954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:01.054382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:01.055061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:01.055534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:01.055948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:01.186247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:01.195212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:01.196658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:01.197797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f79db93b-0014-472b-9ab0-5c9160327f06 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1795 microversion: 2.20 time: 0.156426 Sep 11 10:53:01.198345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 367/710] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:53:01 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:53:01.876846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:01.877454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:01.883871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:01.884357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:01.884793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:01.885479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:01.885935 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:01.886608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:02.016593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:02.024852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2b1247c9-393b-4719-aefe-29773534ea9d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152359 Sep 11 10:53:02.025413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 344/711] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:01 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:03.049538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:03.050132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:03.056658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:03.057142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:03.057584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:03.058508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:03.058967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:03.059393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:03.185768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:03.193842 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-02eb3821-a51b-4a7e-8d5b-cdccf332c660 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.148163 Sep 11 10:53:03.194404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 368/712] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:03 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:04.217278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:04.217889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:04.224433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:04.224915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:04.225358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:04.226051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:04.226509 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:04.226937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:04.359266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:04.368537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-07104e58-bed5-4e6b-a7b4-14b1e51fb614 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.155049 Sep 11 10:53:04.369138 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 345/713] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:04 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:05.392014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:05.392612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:05.399027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:05.399529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:05.399962 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:05.400636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:05.401078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:05.401493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:05.531494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:05.540487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-072f0b5b-1157-4681-a7e0-4d9475c62d46 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152183 Sep 11 10:53:05.541053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 369/714] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:05 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:06.564096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:06.564745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:06.571172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:06.571687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:06.572120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:06.572803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:06.573251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:06.573745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:06.699863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:06.707984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-67e7ef91-56b8-4a24-93e9-651d90794df6 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.147865 Sep 11 10:53:06.708543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 346/715] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:06 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:07.730457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:07.731029 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:07.737673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:07.738155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:07.738584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:07.739265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:07.739762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:07.740183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:07.870700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:07.878891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-23601aef-4998-4323-b5d9-edad765e456b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152590 Sep 11 10:53:07.879589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 370/716] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:07 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:08.903581 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:08.904216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:08.910471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:08.910946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:08.911375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:08.912079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:08.912526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:08.912946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:09.044140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:09.052275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e55c2f4b-0e1a-4493-aa4d-2e68885882f3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152968 Sep 11 10:53:09.052829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 347/717] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:08 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:10.075360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:10.075991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:10.082418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:10.082897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:10.083330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:10.084040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:10.084494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:10.084923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:10.216431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:10.224315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7ce39b18-39d5-43da-8bb6-10b93fb39825 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152822 Sep 11 10:53:10.224870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 371/718] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:10 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:11.249001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:11.249605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:11.256217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:11.256697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:11.257128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:11.257814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:11.258262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:11.258682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:11.389328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:11.397452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a04fa93f-0050-4578-b7f5-47d6886870bc tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.153052 Sep 11 10:53:11.398009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 348/719] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:11 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:12.420620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:12.421238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:12.423643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=46 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:12.428844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:12.429334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:12.429768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:12.430452 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:12.430910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:12.431336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:12.445892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:12.560681 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:12.568845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d4bc8af5-693f-4be9-89fd-21bec36ae9ba tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152168 Sep 11 10:53:12.569341 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 372/720] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:12 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:13.592846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:13.593447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:13.595765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=39 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:13.601070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:13.601554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:13.601983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:13.602667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:13.603147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:13.603666 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:13.732248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:13.740526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-04d0db1d-97fa-4870-82a0-c4add735992b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.152370 Sep 11 10:53:13.741085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 349/721] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:13 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:14.764109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:14.764656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:14.770973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:14.771473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:14.771899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:14.772575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:14.773019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:14.773439 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:14.904886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:14.912967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0fbcb4b2-6ad7-4f28-8433-f653b5eca0fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1736 microversion: 2.1 time: 0.153242 Sep 11 10:53:14.913521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 373/722] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:14 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:15.937344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:15.937953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:15.945079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:15.945566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:15.946014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:15.946724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:15.947178 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:15.947645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.078274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:16.086605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-aede8f5e-91e2-4c2e-879f-066fed60471d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1716 microversion: 2.1 time: 0.153748 Sep 11 10:53:16.087168 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 350/723] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:15 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:16.149506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:16.150021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:16.156661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.157144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.157581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.158274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.158728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.159194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.284377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] HTTP exception thrown: Cannot 'detach_volume' instance 153cc7c6-3af0-42a2-a57a-93a485f4905b while it is in vm_state rescued Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Request method failure captured: Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments/b096b920-7236-48d1-a00d-b4388918d616 HTTP/1.1 Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyapJ6d7YaIKNmoRkGyG0j6dw_m_mO3dKCf5k-Boq5jePo2iEGW4FJQBwKwqxOV9xRFuJzzalZqmyX80rGwYB2MRfpmN-DbY-bNekyQezP1luSe-wYYdiBLMPxD4bwiH6vJK0p3S06ZJg7xritJMI7FPFoNLabXQPcf0tl3wshTV3Q Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:53:16.287540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_528ee82fc48247eea01a17898488ea3e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/528ee82fc48247eea01a17898488ea3e"}]}] Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f6eaba3a278e4bc99aca0dedd649fa9f Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:53:16.289153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Cannot 'detach_volume' instance 153cc7c6-3af0-42a2-a57a-93a485f4905b while it is in vm_state rescued Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'server_id': '153cc7c6-3af0-42a2-a57a-93a485f4905b', 'id': 'b096b920-7236-48d1-a00d-b4388918d616'} Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:53:16.290117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 153cc7c6-3af0-42a2-a57a-93a485f4905b while it is in vm_state rescued Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 153cc7c6-3af0-42a2-a57a-93a485f4905b while it is in vm_state rescued Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:53:16.291446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Returning 409 to user: Cannot 'detach_volume' instance 153cc7c6-3af0-42a2-a57a-93a485f4905b while it is in vm_state rescued {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:53:16.293233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ff47c385-2e88-4dfa-a9fc-13fff1c7b8bd tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments/b096b920-7236-48d1-a00d-b4388918d616" status: 409 len: 152 microversion: 2.1 time: 0.144313 Sep 11 10:53:16.293233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 374/724] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:53:16 2022] DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments/b096b920-7236-48d1-a00d-b4388918d616 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 10:53:16.300166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:16.300737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:16.309154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.309653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.310096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.310809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.311270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.311731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.379186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e6af529b-df28-4562-816d-27255d87925d tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/action" status: 202 len: 0 microversion: 2.1 time: 0.082872 Sep 11 10:53:16.380005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 351/725] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:53:16 2022] POST /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:53:16.388099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:16.388739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:16.395310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.395861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.396389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.397105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:16.397635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:16.398059 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:16.609344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:16.617666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ef801606-e93e-4412-bc8b-7e17c7a57605 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1724 microversion: 2.1 time: 0.233411 Sep 11 10:53:16.618260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 375/726] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:16 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:17.642545 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:17.643266 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:17.649555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:17.650039 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:17.650480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:17.651201 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:17.651700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:17.652129 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:17.779012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:17.787280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3fdc7b7f-c7ba-4c85-913e-ad300df3cc3a tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1724 microversion: 2.1 time: 0.149066 Sep 11 10:53:17.787864 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 352/727] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:17 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:18.810951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:18.811583 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:18.818924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:18.819442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:18.819881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:18.820560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:18.821004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:18.821419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:18.954877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:18.963075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0437b8a9-d8ea-4ae5-b491-0fe2280f58c3 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1724 microversion: 2.1 time: 0.156170 Sep 11 10:53:18.963674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 376/728] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:18 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:19.990259 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:19.991500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:20.002182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:20.002976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:20.003772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:20.005001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:20.005820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:20.006602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:20.135007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:20.143722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1dea97d4-ce17-4026-b56a-2d245a363a9e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1730 microversion: 2.1 time: 0.160590 Sep 11 10:53:20.144284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 353/729] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:19 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:20.166459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:20.166998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:20.173417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:20.173889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:20.174318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:20.174996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:20.175470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:20.175891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:20.253197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4bdc0651-8abf-4c38-b1a6-5287ff1b44bb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090433 Sep 11 10:53:20.253720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 377/730] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 10:53:20 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:53:21.375161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:21.384686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:21.385188 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:21.386325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:21.397195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] Creating event network-changed:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:53:21.402473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-cd577473-3079-4a8d-92d6-4412b37a97eb req-2bfbed71-5876-4061-81b7-7b05a5136db0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086852 Sep 11 10:53:21.403058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 354/731] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:53:23.416667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:23.426612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:23.427084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:23.427543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:23.440316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] Creating event network-changed:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:53:23.445316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-9cb88188-4ba9-4abf-a4d7-aeda41f47f36 req-e6da3db2-c960-49ac-ab33-ebe7de1911f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032772 Sep 11 10:53:23.445947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 378/732] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:53:43.518674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=11 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.519456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.524318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:43.527463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:43.536006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:43.536498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:43.536951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:43.537635 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:43.538093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:43.538517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:43.609195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4010e4a8-18e0-485e-8c2c-a577be8dbe9d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action" status: 202 len: 0 microversion: 2.1 time: 0.092025 Sep 11 10:53:43.609881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 355/733] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:53:43 2022] POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:53:43.615973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 10:53:43.616443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sun Sep 11 10:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d (ip 10.222.0.15) !!! Sep 11 10:53:43.617322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=13 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.618046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=33 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.622882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:43.623603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:43.632248 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:43.632845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:43.633266 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:43.634030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:43.634579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:43.635892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:43.858368 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:43.867137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ecd1f41a-770b-4320-a7a0-3a0ec03ea4db tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1753 microversion: 2.1 time: 0.252838 Sep 11 10:53:43.868014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 379/734] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:43 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1753 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:44.896793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:44.897487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:44.903618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:44.904103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:44.904538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:44.905227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:44.905679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:44.906104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:45.048201 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:45.056460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-29640334-1794-46d3-8c90-d90fdd3a82b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.164502 Sep 11 10:53:45.057657 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 356/735] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:44 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:46.080797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:46.081406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:46.087559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:46.088088 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:46.088624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:46.089427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:46.089880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:46.090304 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:46.235816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:46.245742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a96eeb1f-c1b1-41a4-b2bf-147cad51dd22 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.168649 Sep 11 10:53:46.246294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 380/736] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:46 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:47.270269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:47.270867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:47.277704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:47.278181 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:47.278617 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:47.279310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:47.279795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:47.280216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:47.420470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:47.428690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a16e0f93-2abd-4656-8d24-f0b632b0f4fa tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.162320 Sep 11 10:53:47.429249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 357/737] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:47 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:48.452759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:48.453389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:48.459976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:48.460457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:48.460889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:48.461582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:48.462030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:48.462450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:48.607380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:48.615815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6365d0aa-360b-48da-9296-4e9a0122396b tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.166831 Sep 11 10:53:48.616377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 381/738] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:48 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:53:49.068649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:49.069198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:49.076192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.076675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.077110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.077799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.078249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.078671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.100919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lazy-loading 'flavor' on Instance uuid f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:53:49.173013 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b9015a8e-8629-434a-8287-936c4ff61726 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "POST /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.108013 Sep 11 10:53:49.173575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 358/739] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:53:49 2022] POST /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:53:49.181772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:49.182387 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:49.188539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.189051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.189494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.190436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.191112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.191691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.325491 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:49.333159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-876b61e7-7adb-4a58-ab51-d9f9ca2b4fbf tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.155282 Sep 11 10:53:49.333726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 382/740] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:49 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:49.641250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:49.641856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:49.647856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.648332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.648763 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.649437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:49.649882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:49.650313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:49.790478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:49.798663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-96a6de17-0a98-4d1f-9f2e-868a2de8d072 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.161718 Sep 11 10:53:49.799230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 359/741] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:49 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:50.357366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:50.357976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:50.364645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:50.365189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:50.365637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:50.366380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:50.366833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:50.367256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:50.503244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:50.511478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-60e42a40-bfb8-4fdc-b531-41deaa41a8d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.158514 Sep 11 10:53:50.512048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 383/742] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:50 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:50.823558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:50.824306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:50.830587 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:50.831067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:50.831526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:50.832213 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:50.832661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:50.833079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:51.052437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:51.060591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dc8ea355-c08c-4a08-8d0c-9fdfdd9ec5b6 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.241120 Sep 11 10:53:51.061160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 360/743] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:50 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:51.534026 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:51.534637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:51.541048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:51.541596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:51.542038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:51.542721 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:51.543171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:51.543631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:51.673092 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:51.680645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-266c7fc9-1221-4382-8dc7-c794c0828942 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.150475 Sep 11 10:53:51.681215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 384/744] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:51 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:52.084117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:52.084731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:52.091331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:52.091844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:52.092279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:52.092971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:52.093422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:52.093848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:52.233927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:52.242051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-06e41b5c-c0c7-4491-8610-44b085a387ae tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.161789 Sep 11 10:53:52.242614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 361/745] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:52 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:52.703332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:52.703965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:52.710319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:52.710791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:52.711216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:52.711919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:52.712361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:52.713297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:52.847561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:52.855395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ea8ad10b-2c99-4347-b5a5-2f99adcace7f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.155883 Sep 11 10:53:52.855985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 385/746] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:52 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:53.266357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:53.266966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:53.273294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:53.273775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:53.274209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:53.274898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:53.275350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:53.275807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:53.413357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:53.421523 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fc0ca850-fc9d-4207-9db2-2a8044cf9899 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.159010 Sep 11 10:53:53.422088 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 362/747] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:53 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:53.877987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:53.878567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:53.885951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:53.886425 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:53.886851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:53.887571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:53.888014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:53.888461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:54.022520 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:54.030404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fc566ca6-052e-4d52-8050-800635b6725b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.156201 Sep 11 10:53:54.030965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 386/748] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:53 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:54.445591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:54.446200 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:54.453209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:54.453690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:54.454121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:54.454808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:54.455256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:54.455706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:54.600441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:54.609147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-943f7d37-1618-4b78-b4f6-686eea77727d tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1758 microversion: 2.1 time: 0.167188 Sep 11 10:53:54.609710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 363/749] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:54 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:55.053843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:55.054446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:55.061539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.062015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.062441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.064395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.064958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.065381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.206729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:55.215360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5a57df19-1b09-496b-bbe7-dd7926b5d16c tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.165389 Sep 11 10:53:55.215971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 387/750] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:55 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:55.453283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:55.453864 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:55.460182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.460660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.461091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.461846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.462297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.463233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.596350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lazy-loading 'services' on Instance uuid 936f747a-7ced-4807-a2fe-72d35d9b9b20 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:53:55.632444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:55.633146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:55.640137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.640682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.641181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.642254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:55.643105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:55.643610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:55.710280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-96781583-3f35-41cc-8ed6-2b5adf5a7791 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments/f5401c9b-bd3d-4850-a02c-bb4064be5275" status: 202 len: 0 microversion: 2.1 time: 0.260760 Sep 11 10:53:55.710898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 364/751] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:53:55 2022] DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments/f5401c9b-bd3d-4850-a02c-bb4064be5275 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:53:55.799519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:55.808234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5cbcade0-9d59-47c7-9464-58ef560eeedb tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1761 microversion: 2.1 time: 0.180103 Sep 11 10:53:55.808799 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 388/752] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:55 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:53:56.239961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:56.240568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:56.247605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:56.248089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:56.248517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:56.249198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:56.249646 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:56.250065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:56.380503 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:56.389094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ec6f22cb-aa0c-41da-8174-1c2389c58402 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.153485 Sep 11 10:53:56.389653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 365/753] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:56 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:57.412239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:57.412872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:57.420117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:57.420594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:57.421031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:57.421700 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:57.422155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:57.422572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:57.555006 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:57.563387 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cf7fbaff-e8b2-4599-bcb4-49ff6f37f629 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.155021 Sep 11 10:53:57.563910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 389/754] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:57 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:57.897931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:53:57.905520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:57.906008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:57.906445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:57.928686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Going to try to stop instance {{(pid=137534) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 10:53:57.961810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:57.971570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e558bdd8-15ea-4179-b623-01c465e626bd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action" status: 202 len: 0 microversion: 2.1 time: 0.077294 Sep 11 10:53:57.972195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 366/755] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:53:57 2022] POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:53:57.981310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:57.981926 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:57.988450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:57.989017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:57.989476 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:57.990171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:57.990663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:57.991187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:58.119718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:58.127627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1c55e080-4a26-4862-a7d9-2b43df3b98b9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.151001 Sep 11 10:53:58.128196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 390/756] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:57 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:53:58.586662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:58.587358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:58.593937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:58.594427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:58.594866 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:58.595591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:58.596048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:58.596477 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:58.732550 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:58.740436 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fd63c674-9a1a-4d64-98d2-51949bbd2175 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.158650 Sep 11 10:53:58.741001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 367/757] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:58 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:59.151783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:59.152400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:59.158883 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:59.159362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:59.159837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:59.160533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:59.160987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:59.161408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:59.293976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:59.301554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b119bdfb-e7b0-4a60-b565-63cbed0f02dd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.153766 Sep 11 10:53:59.302114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 391/758] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:59 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:53:59.765928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:53:59.766877 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:53:59.774137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:59.774624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:59.775130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:59.776600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:53:59.777052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:53:59.777473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:53:59.984125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:53:59.991697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f6c4520c-46f0-43ec-a4d3-a7c4af59db59 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.231091 Sep 11 10:53:59.992256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 368/759] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:53:59 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:00.325657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:00.326254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:00.332549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:00.333027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:00.333455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:00.334131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:00.334575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:00.334993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:00.462361 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:00.470635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ef9c5e21-d29f-4fdc-944d-45b36cc98d9f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.149359 Sep 11 10:54:00.471206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 392/760] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:00 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:01.016772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:01.017463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:01.023887 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:01.024379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:01.024820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:01.025520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:01.025974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:01.026403 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:01.157768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:01.166057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c415b28f-0a35-482e-8445-013d6b218a6b tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.152679 Sep 11 10:54:01.166536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 369/761] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:01 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:01.493539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:01.494325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:01.500660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:01.501138 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:01.501569 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:01.502244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:01.502688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:01.503105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:01.635897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:01.643485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-302dcfbd-557f-4fb7-a8d5-2192671b5a50 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.153793 Sep 11 10:54:01.644050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 393/762] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:01 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:02.189375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:02.189988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:02.196298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:02.197286 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:02.197735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:02.198424 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:02.198880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:02.199303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:02.336436 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:02.346247 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-24676ef3-3d21-48cb-b4b7-b8eb5cae2792 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.160465 Sep 11 10:54:02.346821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 370/763] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:02 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:02.667658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:02.668262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:02.674692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:02.675167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:02.675654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:02.676360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:02.676806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:02.677221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:02.812032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:02.819742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1dafa79f-b6e4-44bc-916f-69659a72b9a8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.156737 Sep 11 10:54:02.820294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 394/764] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:02 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:03.369910 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:03.370535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:03.376870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.377352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.377791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.378479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.378957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.379379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.507223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:03.515613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e29963ff-9fd7-4b2a-a5ac-5f12ef38b62a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1510 microversion: 2.1 time: 0.149679 Sep 11 10:54:03.516182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 371/765] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:03 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:03.538381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:03.538970 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:03.545604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.546078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.546505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.547177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.547661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.548074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.564112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:03.577161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137535) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 10:54:03.640348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7fbd3038-cf81-4cfb-a48c-336c64162716 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "POST /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.105834 Sep 11 10:54:03.641210 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 395/766] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:54:03 2022] POST /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:54:03.649058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:03.649695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:03.656521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.657006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.657436 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.658128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.658572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.658989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.799697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:03.808936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-55effec3-a9b7-4208-a127-8c921be8472d tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1518 microversion: 2.1 time: 0.163282 Sep 11 10:54:03.809679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 372/767] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:03 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:03.844372 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:03.845203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:03.851871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.852352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.852793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:03.854392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:03.855056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:03.855706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:04.005969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:04.013860 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1b237261-2adf-4d87-8544-05343edbae9a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.174764 Sep 11 10:54:04.014431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 396/768] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:03 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:04.806999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "name": "network-vif-unplugged", "status": "completed", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:04.816926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:04.817404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:04.817827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:04.830030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.compute.server_external_events [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] Unable to find a host for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4. Dropping event network-vif-unplugged {{(pid=137534) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 10:54:04.830913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-0b764b61-9ae8-4760-a6c7-0913da13c3f4 req-ef097c5e-dffb-42c7-bbda-ef13e76ee329 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028365 Sep 11 10:54:04.831699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 373/769] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 11 10:54:04.832394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:04.833371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:04.839594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:04.840154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:04.840660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:04.841422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:04.842115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:04.842784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:04.974704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:04.982506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0795b1ea-1260-4acf-9bd7-126a1f83d4ee tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1520 microversion: 2.1 time: 0.154644 Sep 11 10:54:04.983074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 397/770] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:04 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:05.038238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:05.038834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:05.045819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:05.046302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:05.046734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:05.047525 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:05.047979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:05.048403 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:05.185507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:05.193781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-accbd6d8-6751-4df8-9ade-d1a60b2c8131 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.159544 Sep 11 10:54:05.194460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 374/771] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:05 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:06.006061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:06.006671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:06.013310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:06.013803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:06.014237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:06.014943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:06.015395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:06.015846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:06.197663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:06.205384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-563a84f9-8143-4997-94fd-36bbd2889e82 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.203158 Sep 11 10:54:06.205951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 398/772] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:06 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:06.218383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:06.218990 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:06.225547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:06.226026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:06.226458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:06.227150 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:06.227645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:06.228913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:06.423478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:06.431236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2031c24f-d760-4d98-9ecf-6df3bdeaf4b3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.216530 Sep 11 10:54:06.432179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 375/773] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:06 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:07.229568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:07.230166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:07.236784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:07.237264 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:07.237696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:07.238378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:07.238828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:07.239251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:07.371547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:07.379125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4e35f1cb-085d-4a77-aac1-0449847a6531 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.153947 Sep 11 10:54:07.379705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 399/774] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:07 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:07.454977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:07.455615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:07.462040 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:07.463089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:07.463558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:07.464248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:07.464696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:07.465117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:07.594665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:07.602269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bf2e17db-1517-4aea-a502-bad2fed31ef7 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.151441 Sep 11 10:54:07.602850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 376/775] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:07 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:08.071166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:08.072394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:08.078499 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.078983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.079415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.080149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.080600 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.081021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.109693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-844ad193-630d-459a-9cb1-d45773632a44 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments/da859933-d37d-4d09-9ca8-eb43e347f5cd" status: 200 len: 194 microversion: 2.20 time: 0.042516 Sep 11 10:54:08.110260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 400/776] 10.222.0.15 () {60 vars in 1454 bytes} [Sun Sep 11 10:54:08 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments/da859933-d37d-4d09-9ca8-eb43e347f5cd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:54:08.181621 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:08.182155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:08.188128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.188653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.189034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.189709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.190157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.190603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.270499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lazy-loading 'services' on Instance uuid 0b830749-7cd2-44a9-8809-d6ff81ec2da1 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:08.342989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e0ed45b3-7bf1-4f9d-8c45-68f5f659ec92 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments/da859933-d37d-4d09-9ca8-eb43e347f5cd" status: 202 len: 0 microversion: 2.20 time: 0.165344 Sep 11 10:54:08.343588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 377/777] 10.222.0.15 () {60 vars in 1457 bytes} [Sun Sep 11 10:54:08 2022] DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments/da859933-d37d-4d09-9ca8-eb43e347f5cd => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:54:08.351880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:08.354358 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:08.360949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.361416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.361840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.362514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.362955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.363366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.392812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c8b76a89-8827-4dd7-a17a-55198b7b6424 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044831 Sep 11 10:54:08.393348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 401/778] 10.222.0.15 () {60 vars in 1343 bytes} [Sun Sep 11 10:54:08 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:54:08.403514 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:08.404218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:08.410411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.410901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.411344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.412069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.412530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.412964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.546491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:08.554308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8e06abbd-3e1b-4c4c-afb5-2024c44273d0 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.155544 Sep 11 10:54:08.554870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 378/779] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:08 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:08.625753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:08.626359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:08.632222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.632707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.633148 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.633834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:08.634814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:08.635240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:08.761397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:08.769016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2b5eff08-398c-4b67-af59-04b3939520a3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1678 microversion: 2.1 time: 0.147147 Sep 11 10:54:08.769604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 402/780] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:08 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:09.405941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:09.408566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:09.414627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.416146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.416413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.417645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.418385 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.418849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.450392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-89911d4b-0c81-4591-b619-bbc16dbb5b6d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049784 Sep 11 10:54:09.450939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 379/781] 10.222.0.15 () {60 vars in 1343 bytes} [Sun Sep 11 10:54:09 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:54:09.577975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:09.578512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:09.584970 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.585451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.585885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.586570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.587025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.587656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.716383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:09.723996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0dace343-da96-4607-89b5-57eeebcd2dd7 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.149932 Sep 11 10:54:09.724550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 403/782] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:09 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:09.792905 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:09.793520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:09.799936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.801406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.801863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.802611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.803164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.803589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.930379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:09.938419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-35794aaf-5777-4afa-ab5a-f666a9eae896 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1655 microversion: 2.1 time: 0.150146 Sep 11 10:54:09.938980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 380/783] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:09 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:09.960742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:09.967221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:09.967836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:09.968280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:09.990733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Going to try to start instance {{(pid=137535) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 10:54:10.031621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fd5fcfd0-c8de-4a9e-9462-7dac98dbad47 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action" status: 202 len: 0 microversion: 2.1 time: 0.074590 Sep 11 10:54:10.032416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 404/784] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:54:09 2022] POST /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:54:10.053032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:10.053674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:10.060235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.060711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.061140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:10.061824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.062272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.062720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:10.195182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:10.204345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4cb23c72-d988-46f4-93b2-3ec35637de3f tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1664 microversion: 2.1 time: 0.155370 Sep 11 10:54:10.204902 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 381/785] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:10 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:10.464299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:10.466513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:10.472726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.473250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.473690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:10.474392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.474848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.475273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:10.508678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f4851b65-2afa-4bab-a50d-993c45d2f699 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049177 Sep 11 10:54:10.510161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 405/786] 10.222.0.15 () {60 vars in 1343 bytes} [Sun Sep 11 10:54:10 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:54:10.748364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:10.749145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:10.755891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.756126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.756498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:10.757208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:10.757718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:10.758161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.100299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:11.110450 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a79241ad-49e0-4797-8572-b7640980eaaa tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.366353 Sep 11 10:54:11.111277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 382/787] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:10 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:11.228100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:11.228715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:11.235338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.235869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.236287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.236972 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.237417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.237834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.367566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:11.376064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4ba69edd-4fa4-427e-85a1-a1731a2ffeff tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1664 microversion: 2.1 time: 0.151953 Sep 11 10:54:11.376622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 406/788] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:11 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:11.521367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:11.523609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:11.529726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.530210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.530645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.531333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.531816 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.532239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.548730 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:11.563307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fa217c5c-8083-41ae-8c9d-b0b6a2ef2aed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045894 Sep 11 10:54:11.563820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 383/789] 10.222.0.15 () {60 vars in 1343 bytes} [Sun Sep 11 10:54:11 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:11.630879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:11.631407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:11.637412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.637894 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.638329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.639014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.639498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.639925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.663650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:54:11.757608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5c3b281c-740a-4679-85d0-41945242c8d4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 204 len: 0 microversion: 2.20 time: 0.130308 Sep 11 10:54:11.758250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 407/790] 10.222.0.15 () {60 vars in 1280 bytes} [Sun Sep 11 10:54:11 2022] DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 10:54:11.766443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:11.767049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:11.772903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.773392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.773837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.774532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:11.775221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:11.775687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:11.907732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:11.916581 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:11.918037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:11.919208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-85484172-5e42-4a8a-b8cc-0a77431439a7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.156621 Sep 11 10:54:11.919794 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 384/791] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:11 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:12.134793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:12.135450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:12.141289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.141768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.142193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.142871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.143316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.143818 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.161956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:12.278016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:12.285772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5ce4a6f4-b232-4f2d-a34d-db0522773b28 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.155535 Sep 11 10:54:12.286335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 408/792] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:12 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:12.400885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:12.401507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:12.407265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.407773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.408207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.408885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.409333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.409755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.537035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:12.544682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f7797195-d1aa-4d1b-b6f9-8adb859ab5d9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1668 microversion: 2.1 time: 0.148527 Sep 11 10:54:12.545245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 385/793] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:12 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:12.945507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:12.946124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:12.954147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.954421 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:12.954635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.954918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:12.955072 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.955954 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.956418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.956844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.961157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.961641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.962080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.962786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:12.963231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:12.963708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:12.988917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:54:13.065276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-08036511-f552-45f1-8085-d1809ceac9ff tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 204 len: 0 microversion: 2.1 time: 0.114300 Sep 11 10:54:13.065845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 386/794] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:54:12 2022] DELETE /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 10:54:13.074807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:13.075521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:13.081124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:13.081604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:13.082034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:13.082722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:13.083171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:13.083632 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:13.091512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:13.099636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:13.101396 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:13.102551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-64ebd51b-25ac-4cd0-aa90-ebdb0c2d1e19 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.161046 Sep 11 10:54:13.103792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 409/795] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:12 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:13.216261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:13.223925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d1d1c6de-c1d2-45b6-8ad0-82ffe088dee0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1576 microversion: 2.1 time: 0.153800 Sep 11 10:54:13.224490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 387/796] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:13 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:13.272458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "name": "network-vif-plugged", "status": "completed", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:13.282839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:13.284019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:13.284451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:13.296600 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] Creating event network-vif-plugged:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:54:13.301321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-b5ad2657-1bee-4b67-b510-cda74246d6d3 req-7ff99b1f-6c9e-4c2e-a476-dcf818115dec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032705 Sep 11 10:54:13.301907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 410/797] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:13.310776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:13.311600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:13.317367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:13.317845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:13.318335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:13.319034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:13.319508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:13.319928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:13.450427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:13.458097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a547b92d-e1b8-43ee-bbcf-31770ae1257f tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.152258 Sep 11 10:54:13.458659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 388/798] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:13 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:14.129829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:14.130527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:14.132487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:14.138378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.138863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.139298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.140018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.140472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.140895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.248955 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:14.249575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:14.252025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:14.257278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.257770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.258209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.258910 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.259395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.259853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.272422 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:14.281330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:14.282760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:14.284169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5caba266-4fe2-40d9-9b52-b2be78bd0fe2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.158840 Sep 11 10:54:14.289358 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 411/799] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:14 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:14.392026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:14.400190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fbd6fb35-9696-4cb0-af3f-c283217ace6c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1576 microversion: 2.1 time: 0.154578 Sep 11 10:54:14.400805 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 389/800] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:14 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:14.482223 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:14.482849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:14.489956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.490545 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.491079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.491902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:14.492468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:14.493102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:14.624965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:14.632562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4cb8a90f-43d5-4b16-a728-4ae78c8326e5 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.154861 Sep 11 10:54:14.633127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 412/801] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:14 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:15.310218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:15.310822 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:15.317324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.317801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.318228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.318907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.319355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.319799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.424534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:15.425124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:15.431761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.432247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.432684 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.433375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.433820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.434240 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.449902 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:15.458439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:15.459882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:15.461035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c9c0c171-4fc9-45b0-8001-86f414599b57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.155635 Sep 11 10:54:15.461645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 390/802] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:15 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:15.567923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:15.575801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7663263e-88c9-491f-8547-0a3316b23427 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1576 microversion: 2.1 time: 0.155100 Sep 11 10:54:15.576367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 413/803] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:15 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:15.656022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:15.656633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:15.662391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.662878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.663313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.664029 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:15.664483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:15.664914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:15.800329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:15.808407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c441a31e-0fb0-4910-a78f-7162c7887ec1 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.156147 Sep 11 10:54:15.808973 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 391/804] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:15 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:16.486585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:16.487140 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:16.493575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.494288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.494725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.495443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.495904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.496324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.598793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:16.599446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:16.606461 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.606960 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.607394 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.608125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.608580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.609255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.906202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:16.914449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:16.915971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:16.917143 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-57b43710-b7a1-41c4-99b2-ef893761131c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1723 microversion: 2.20 time: 0.434866 Sep 11 10:54:16.917702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 414/805] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:16 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:16.922701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:16.923943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:16.931007 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.932209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.932813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.935654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:16.936197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:16.936631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:16.964505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:16.977526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b54c4d9c-30d4-45d9-92f3-bf6c39d48a3c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1576 microversion: 2.1 time: 0.382257 Sep 11 10:54:16.978603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 392/806] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:16 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:17.262091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:17.271752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-87aa7428-50b5-4595-b5f5-d5f2f4f788cb tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1576 microversion: 2.1 time: 0.352219 Sep 11 10:54:17.285360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 415/807] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:16 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1576 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:17.943395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:17.945845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:17.953629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:17.954216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:17.954929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:17.955980 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:17.956704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:17.957222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:17.985761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b830749-7cd2-44a9-8809-d6ff81ec2da1", "name": "network-vif-deleted", "tag": "f2304c8a-f0f4-4aef-a4c0-1196e386f61f"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:18.007958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:18.008853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:18.010603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:18.025668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] Creating event network-vif-deleted:f2304c8a-f0f4-4aef-a4c0-1196e386f61f for instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 on hv-cinder-85646 Sep 11 10:54:18.034713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-39854532-408e-47dc-b543-f218ecf845da req-972dfdd5-d29f-4a24-85fa-d5246bfddebf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056604 Sep 11 10:54:18.041864 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 416/808] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:18.048671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:18.050141 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:18.062416 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:18.066197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:18.072084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:18.073512 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:18.074204 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:18.074850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:18.075916 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:18.076544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:18.077839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:18.080817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-899703e0-6360-4977-8ec9-8bdb25444b4a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1656 microversion: 2.20 time: 0.141438 Sep 11 10:54:18.081407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 393/809] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:17 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1656 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:18.184760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:18.194841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-aa19b5cb-b461-4a91-9585-d488f2997b13 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1508 microversion: 2.1 time: 0.150553 Sep 11 10:54:18.207869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 417/810] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:18 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:18.296593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:18.297502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:18.304844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:18.305746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:18.306944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:18.309521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:18.310400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:18.311158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:18.537624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:18.546400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-621acae4-533f-49ed-907a-186a27141936 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1563 microversion: 2.1 time: 0.254636 Sep 11 10:54:18.561821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 394/811] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:18 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:19.111811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:19.113343 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:19.120712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.121450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.121888 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.122597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.123091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.123548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.157559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.158130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.158642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.159164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lazy-loading 'fault' on Instance uuid 0b830749-7cd2-44a9-8809-d6ff81ec2da1 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:19.218390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:19.219045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:19.221096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:19.230542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:19.230764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.231075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.231914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.232345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:19.234698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-74ad2f9e-a94b-4a28-80a1-461fb42e5d11 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 200 len: 1371 microversion: 2.20 time: 0.127070 Sep 11 10:54:19.247531 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 418/812] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:19 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:19.247712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.247712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.247712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.283394 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:19.283906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:19.284409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:19.284965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lazy-loading 'fault' on Instance uuid 646d54e0-29b4-45c0-aa4b-4d540825d887 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:19.338170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:19.348986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e972c18c-681d-4f82-8283-46928681bdc3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 200 len: 1229 microversion: 2.1 time: 0.134409 Sep 11 10:54:19.350179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 395/813] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:19 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:20.054632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646d54e0-29b4-45c0-aa4b-4d540825d887", "name": "network-vif-deleted", "tag": "e62f0749-ab15-40f3-b785-e90aadfb68ed"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:20.065180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:20.065688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:20.066108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:20.078300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] Creating event network-vif-deleted:e62f0749-ab15-40f3-b785-e90aadfb68ed for instance 646d54e0-29b4-45c0-aa4b-4d540825d887 on hv-cinder-85646 Sep 11 10:54:20.083753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-81d51929-0899-4492-9479-19793eba872a req-4bb82656-621f-4ad1-98e6-5825664421b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032535 Sep 11 10:54:20.084342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 419/814] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:20.261187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:20.261787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:20.268161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:20.268635 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:20.269066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:20.269748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:20.270195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:20.270613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:20.284476 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 HTTP/1.1 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:54:20.286134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:54:20.287952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '0b830749-7cd2-44a9-8809-d6ff81ec2da1'} Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:54:20.288909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:54:20.291250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.292800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:54:20.292800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d9f3939a-fa78-4610-9fd1-e608c3ab27e1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 404 len: 111 microversion: 2.20 time: 0.030582 Sep 11 10:54:20.292800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 396/815] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:20 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:54:20.297806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8d25bd8f-f95d-45b4-8472-5b6ee1e1787f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '.version_select at 0x7f759bdff8b0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:20.322067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8d25bd8f-f95d-45b4-8472-5b6ee1e1787f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-361815833" status: 204 len: 0 microversion: 2.20 time: 0.028148 Sep 11 10:54:20.322641 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 420/816] 10.222.0.15 () {60 vars in 1259 bytes} [Sun Sep 11 10:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-361815833 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 10:54:20.374110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:20.374632 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:20.380551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:20.381033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:20.381465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:20.382155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:20.382603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:20.383024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:20.397198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] HTTP exception thrown: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Request method failure captured: Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 HTTP/1.1 Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb1tX7WdDZoKHtONjpv5wgTfI2iJO232ObARBAgKmDPTRSCdk2CQzDRLUzWJn9sfGKCaqv1ArYB8V0OLBa6rKEDUO3TJ_wRIIoEWfwdjV5cs-h3QXzTklbZ8wF0jFZiATU6QeviQ4x1_LXYhOxB4BGD6jppHXz9e-65XqMIR5cI7cLQ Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:54:20.398731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23556239691f46aa8b39bb6219fc591f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23556239691f46aa8b39bb6219fc591f"}]}] Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-TestVolumeBootPattern-962442226 Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-TestVolumeBootPattern-962442226-project Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: e1b0815853b947bc8f50d91c1ce0ab5a Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-TestVolumeBootPattern-962442226-project Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 10:54:20.400776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '646d54e0-29b4-45c0-aa4b-4d540825d887'} Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:54:20.401735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 10:54:20.403158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:54:20.404520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Returning 404 to user: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:54:20.404520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-32d0898d-af84-4982-a4de-2eb466a99ae3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 404 len: 111 microversion: 2.1 time: 0.031291 Sep 11 10:54:20.415967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 397/817] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:20 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:54:20.521834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552589473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-13039510", "security_groups": [{"name": "tempest-secgroup-smoke-1317451716"}], "block_device_mapping_v2": [{"uuid": "1ac92a16-8cfb-4718-b667-538443f319b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2be92be9-cd67-4fcc-bf1b-6ceeb89de07d"}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:20.741657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] validate_networks() for [('2be92be9-cd67-4fcc-bf1b-6ceeb89de07d', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:54:21.320242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:54:21.320790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:54:21.321124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:54:21.322054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:54:21.322490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:54:21.328125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0d1aac78-0beb-461f-a572-6b1e6dbae704 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: .version_select at 0x7f75a3832310>, body: {"keypair": {"name": "tempest-keypair-1552313392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKzMwW0ul8C8X1LCtuzpUSzlGIgMbNLx3Oy21kGGLfmvfI3PU7+/Xz49Vhnd8QFJ/hdX7lYC4Ug3wwfR9jVI8Ox4t/czviX++0xzEhNcjHaqBBmGu2dHzSSNnpISlMOyQ=="}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:21.331182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:21.331689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:21.332120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:21.332839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:21.333294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:21.333715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:21.344505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-0d1aac78-0beb-461f-a572-6b1e6dbae704 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:54:21.348187 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-0d1aac78-0beb-461f-a572-6b1e6dbae704 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for user 2238a62cbf1846999b31ea9434b67743 and project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:54:21.351282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:54:21.355307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for user e1b0815853b947bc8f50d91c1ce0ab5a and project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:54:21.370006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0d1aac78-0beb-461f-a572-6b1e6dbae704 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045811 Sep 11 10:54:21.370792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 398/818] 10.222.0.15 () {62 vars in 1200 bytes} [Sun Sep 11 10:54:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 11 10:54:21.416988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:54:21.419205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ac92a16-8cfb-4718-b667-538443f319b5',volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:54:21.560094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a9aa3955-4f72-46c1-9f05-1bea8be51311 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.042441 Sep 11 10:54:21.560749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 421/819] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:54:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:54:21.572355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9543d045-7a69-4a89-956a-db853e423c05 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:21.573230 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9543d045-7a69-4a89-956a-db853e423c05 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:21.635127 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9543d045-7a69-4a89-956a-db853e423c05 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:21.642585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9543d045-7a69-4a89-956a-db853e423c05 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1093 microversion: 2.1 time: 0.074490 Sep 11 10:54:21.655448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 399/820] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:21 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:22.655578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1930687157", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88c1fa28-e5ca-496f-ae84-b3828068ab9b"}], "security_groups": [{"name": "tempest-securitygroup--487463563"}], "key_name": "tempest-keypair-1552313392", "user_data": "}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:22.667124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:22.667946 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:22.675077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:22.675699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:22.676277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:22.677056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:22.677939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:22.678161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:22.757483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:22.766242 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c2cefe84-055a-4da8-9be6-2d2279ec4bc1 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1191 microversion: 2.1 time: 0.103800 Sep 11 10:54:22.768386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 400/821] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:22 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:22.793341 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] validate_networks() for [('88c1fa28-e5ca-496f-ae84-b3828068ab9b', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:54:23.402660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:54:23.403094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:54:23.403595 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:54:23.404378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:54:23.404378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:54:23.412624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:23.413099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:23.413521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:23.414231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:23.414673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:23.415371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:23.433624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:54:23.437329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Getting quotas for user 2238a62cbf1846999b31ea9434b67743 and project d0f44d45f87c4b28a1672c48fd9613ca. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:54:23.448928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:54:23.451080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:54:23.500065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-08971119-cc2f-474e-8931-fd1ef5c56576 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.848692 Sep 11 10:54:23.500797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 422/822] 10.222.0.15 () {62 vars in 1188 bytes} [Sun Sep 11 10:54:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 11 10:54:23.513511 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:23.514146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:23.599037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:23.611684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:23.613507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:23.614888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2378f11b-a831-49d0-82ad-050577679c00 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1282 microversion: 2.20 time: 0.106194 Sep 11 10:54:23.615880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 401/823] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:23 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:23.791205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:23.791876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:23.801238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:23.804788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:23.805336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:23.806381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:23.811479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:23.811925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:24.058018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:24.067362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0c120d8a-4da3-46f0-b796-5c84587230c9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1277 microversion: 2.1 time: 0.281225 Sep 11 10:54:24.067966 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 423/824] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:23 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:24.642182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:24.642956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:24.649328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:24.649821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:24.650260 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:24.650950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:24.651407 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:24.651850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:24.672328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:24.725718 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:24.734699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:24.736220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:24.737487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ba36952f-6f14-40e7-8e83-cf5f8c052135 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1334 microversion: 2.20 time: 0.099235 Sep 11 10:54:24.737930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 402/825] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:24 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:24.915994 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968c6bd3-170a-4e7f-9019-5d68db62c717", "tag": "a795b231-68a0-4b6a-a947-b5e2d3d47383"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:24.938776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:24.939313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:24.939833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:24.957475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] Creating event network-changed:a795b231-68a0-4b6a-a947-b5e2d3d47383 for instance 968c6bd3-170a-4e7f-9019-5d68db62c717 on hv-cinder-85646 Sep 11 10:54:24.963964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-da106ee5-cb80-4b41-916f-20bf26be3c67 req-b13e0bc7-b6dc-4da6-a6ea-0ebca7a23a11 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056484 Sep 11 10:54:24.964632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 424/826] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:54:25.092405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:25.093298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:25.099177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:25.099921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:25.100530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:25.101432 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:25.101886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:25.102335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:25.361753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:25.369541 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ea43edcf-7f4d-40f7-92cb-14af9956b4ad tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.281444 Sep 11 10:54:25.370107 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 403/827] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:25 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:25.764581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:25.765415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:25.771800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:25.772584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:25.773030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:25.773949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:25.774628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:25.775155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:25.878190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:25.886837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:25.888278 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:25.889404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e4f0223f-2b33-4a6e-8004-4e5f0b3f50bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1340 microversion: 2.20 time: 0.129439 Sep 11 10:54:25.889965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 425/828] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:25 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1340 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:54:26.393747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:26.394359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:26.401101 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:26.401602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:26.402016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:26.402699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:26.403153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:26.403606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:26.529925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:26.537504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8c5cac96-e6dd-49ac-a9a6-d2a5ff7a13b7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.147608 Sep 11 10:54:26.538054 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 404/829] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:26 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:26.914181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:26.915286 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:26.921911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:26.922393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:26.922826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:26.923589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:26.924114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:26.924541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.243965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:27.252486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:27.253908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:27.255011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-88c37da7-b774-49b1-b917-84b566ffc3c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.344790 Sep 11 10:54:27.255596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 426/830] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:26 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:27.560336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:27.560958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:27.567260 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:27.567791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:27.568245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.568917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:27.569371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:27.569796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.793547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:27.812921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7acf9918-9059-4bcd-ad38-235c6245f20f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.256449 Sep 11 10:54:27.813505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 405/831] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:27 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:27.844457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:27.845066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:27.851262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:27.851779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:27.852538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.853312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:27.853771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:27.854194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.926728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:27.942914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:27.943403 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:27.944184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:27.953344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'services' on Instance uuid 153cc7c6-3af0-42a2-a57a-93a485f4905b {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:27.958173 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] Creating event network-changed:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:54:27.962894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-c26c2ff3-526d-49d2-893f-9a3a900cb0ca req-26afe1c8-a52b-4582-9ec8-16e29f8b425f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040166 Sep 11 10:54:27.963947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 406/832] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:54:28.068102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2577833f-f140-42c3-b933-642bcf9decff tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments/b096b920-7236-48d1-a00d-b4388918d616" status: 202 len: 0 microversion: 2.1 time: 0.227612 Sep 11 10:54:28.068699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 427/833] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:54:27 2022] DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments/b096b920-7236-48d1-a00d-b4388918d616 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:54:28.078431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:28.080744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:28.088132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.088723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.089277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:28.090077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.090600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.091236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:28.125934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fab50244-6e6e-4e94-a423-4d74da07d322 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051779 Sep 11 10:54:28.131492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 407/834] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:54:28 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:28.279376 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:28.280098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:28.286296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.286771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.287199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:28.287905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.288350 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.288764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:28.422110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:28.430139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:28.432389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:28.433479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ea34f18-f3cb-4d40-b41b-1f5f3295e79e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.158453 Sep 11 10:54:28.434048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 428/835] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:28 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:28.846592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:28.847190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:28.853918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.854470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.854906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:28.855633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:28.856346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:28.856661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:29.013425 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:29.021081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c723a348-9a65-4cfe-ba94-fb40a70ca2c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.178744 Sep 11 10:54:29.021643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 408/836] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:28 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:29.138850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:29.141120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:29.147529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:29.148018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:29.148457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:29.149850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:29.150327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:29.150756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:29.154465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:29.180811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2e7f1880-4ab3-4cce-b444-50245ea9d3ab tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Sep 11 10:54:29.181367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 429/837] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:54:29 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:29.457710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:29.458323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:29.464502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:29.464989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:29.465429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:29.466119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:29.466577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:29.467007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:29.596934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:29.605487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:29.606915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:29.608044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cd543804-8a52-469b-90f6-2ac54457aba4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.154239 Sep 11 10:54:29.608596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 409/838] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:29 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:30.045359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:30.045961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:30.052145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.052621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.053047 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.053723 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.054173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.054584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.181393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:30.189104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ebb55031-52bb-4a59-992d-c26838e0e0f7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.147735 Sep 11 10:54:30.189660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 430/839] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:30 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:30.192257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:30.194430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:30.200818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.201437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.201878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.202580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.203036 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.203485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.235218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9ef60203-6b9c-42ee-aca3-487c0ebd1be8 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046853 Sep 11 10:54:30.235803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 410/840] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:54:30 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:54:30.633244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:30.634274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:30.640186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.640667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.641098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.641783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:30.642333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:30.642774 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:30.770977 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:30.779175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:30.780642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:30.781743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f3b0033e-d7ed-4d95-b7f7-a2aee296c0f5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.152515 Sep 11 10:54:30.782302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 431/841] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:30 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:54:31.211738 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:31.212452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:31.218775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.219257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.219720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:31.220412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.220865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.221287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:31.248492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:31.251004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:31.258252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.258778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.259247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:31.260267 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.260712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.261142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:31.294804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-16fbedc4-afc5-4880-b686-807d391a4a07 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050229 Sep 11 10:54:31.295400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 432/842] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:54:31 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:54:31.501644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:31.509359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-59814d95-379f-4e68-bc82-dc7b9c6234ac tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.301376 Sep 11 10:54:31.509943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 411/843] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:31 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:31.806863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:31.807536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:31.813852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.814334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.814763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:31.815516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:31.815969 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:31.816398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.201308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:32.209275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:32.210695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:32.212399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-94b05356-3728-4310-8dc8-e207a4c056ed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.409630 Sep 11 10:54:32.213039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 433/844] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:31 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:32.307495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:32.309615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:32.316007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.316497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.316937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.317631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.318084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.318505 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.347255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-34e7ff7f-46b4-45dd-8639-048706d64bfb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043745 Sep 11 10:54:32.347825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 412/845] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:54:32 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:54:32.432914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:32.433417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:32.439741 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.440222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.440656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.441339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.441790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.442213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.467075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:54:32.533060 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:32.533695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:32.539469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.540833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.541384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.542082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.542551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.542958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.543084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8a8e2be6-ed9a-4f50-b3e2-9397387f18ed tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 204 len: 0 microversion: 2.1 time: 0.113840 Sep 11 10:54:32.543870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 434/846] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:54:32 2022] DELETE /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:54:32.552036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:32.552732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:32.558446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.558939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.559375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.560089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:32.560543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:32.560967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:32.745730 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:32.748827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:32.753441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6b935213-5222-4410-be04-df05615bf8ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.224169 Sep 11 10:54:32.754086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 413/847] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:32 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:32.756752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0e73a4fe-b6dd-4bef-b002-8ce9ce9132fb tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.208758 Sep 11 10:54:32.757309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 435/848] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:32 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:33.237754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:33.238645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:33.245444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.245943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.246380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.247080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.247564 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.247992 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.402459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:33.410622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:33.412170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:33.413280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cb55953e-69e6-4b66-83ef-65597bcc2b7b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.179741 Sep 11 10:54:33.413829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 414/849] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:33 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:33.777806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:33.778418 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:33.780409 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=4 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:33.781265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:33.781560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=12 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:33.781673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:33.784627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=8 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:33.787738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.788226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.788475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.788661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.788957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.789356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.789479 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.790449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.790831 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:33.790933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.791288 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:33.791739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:33.992633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:33.995186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:34.001285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f4fd2e3e-4098-49df-9d47-5a9665815014 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.223895 Sep 11 10:54:34.001944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 415/850] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:33 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:34.016530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ad29e72f-9c94-47d0-b8ef-86b3428ef264 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.243102 Sep 11 10:54:34.017217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 436/851] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:33 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:34.439484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:34.440090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:34.447336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:34.447841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:34.448276 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:34.448964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:34.449419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:34.449841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:34.576931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:34.584944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:34.586361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:34.587755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5375ed05-aadd-4084-a2ba-16af99b75de9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.152157 Sep 11 10:54:34.588297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 416/852] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:34 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:35.024702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:35.025339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:35.031710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.032189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.032624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.033344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.033798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.034252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.040120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:35.040847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:35.046723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.047209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.047680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.048377 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.048834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.049639 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.236892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:35.241931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:35.245171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8ddc7bfc-f2c2-4da2-bba4-7d8ebea9f67b tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.224428 Sep 11 10:54:35.246107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 437/853] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:35 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:35.250420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e65f7ba1-f662-492a-894d-e4c1cd498f06 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.214470 Sep 11 10:54:35.251803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 417/854] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:35 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:35.613109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:35.613676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:35.619672 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.620152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.620602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.621465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.621911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.622327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.671467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "name": "network-vif-plugged", "status": "completed", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:35.683566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:35.684496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:35.686153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:35.697687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] Creating event network-vif-plugged:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:54:35.702691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-7f751544-bc6e-4e3c-9db9-af712d51a810 req-5437fbed-b90f-4a19-a68a-b08ea1726fd1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Sep 11 10:54:35.703279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 418/855] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:35.761183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:35.769496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:35.770914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:35.772163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1f4e565e-b84b-4376-8321-0c19f8bb89cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.163303 Sep 11 10:54:35.772721 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 438/856] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:35 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:36.272688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:36.273387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:36.273780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:36.274688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:36.279751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.280290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.280680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.281381 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.281472 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.281840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.281936 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.282264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.282374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.283045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.283660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.284084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.482474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:36.486070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:36.490720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-489b9aff-4cf5-46c9-9d4d-0ae0d02f7503 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.222421 Sep 11 10:54:36.491540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 419/857] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:36 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:36.494575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ac51128f-1ddd-42e1-8943-598e5d9ec5dc tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.224477 Sep 11 10:54:36.495457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 439/858] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:36 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:36.796997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:36.797602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:36.804137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.804643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.805184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.806065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:36.806610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:36.807225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:36.825372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:36.939381 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:36.948273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:36.949778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:36.950966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1111766d-e124-4dce-a4af-6effda8b28df tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.157899 Sep 11 10:54:36.951563 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 420/859] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:36 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:37.515104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:37.515650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:37.516966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:37.517605 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:37.519083 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:37.523267 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.523767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.523923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.524296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.524473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.524787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.525049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.525506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.525640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.525927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.526031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.526388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.721435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:37.724692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:37.729462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a6e56a24-00f7-4b22-a84b-e26ff887060b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.216207 Sep 11 10:54:37.730029 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 421/860] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:37 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:37.733054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-095ef613-a8bb-4a67-af42-d7815682a6a4 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.221939 Sep 11 10:54:37.733688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 440/861] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:37 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:37.978090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:37.978692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:37.985790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.986383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.986697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.987388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:37.987879 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:37.988365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:37.994533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968c6bd3-170a-4e7f-9019-5d68db62c717", "name": "network-vif-plugged", "status": "completed", "tag": "a795b231-68a0-4b6a-a947-b5e2d3d47383"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:38.006219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:38.006219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:38.006751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:38.018390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] Creating event network-vif-plugged:a795b231-68a0-4b6a-a947-b5e2d3d47383 for instance 968c6bd3-170a-4e7f-9019-5d68db62c717 on hv-cinder-85646 Sep 11 10:54:38.032651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-63cfa339-c59a-430d-9335-0c8906496bd1 req-3170d2ca-83e2-4f46-bc9f-b31a9b291620 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042131 Sep 11 10:54:38.044314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 441/862] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:38.174766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:38.183492 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:38.184929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:38.186023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8b3f3696-c2bf-4a7a-988b-b6c519b8baee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1407 microversion: 2.20 time: 0.213391 Sep 11 10:54:38.186593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 422/863] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:37 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:38.753874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:38.754571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:38.762532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:38.763144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:38.769274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:38.769645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:38.769768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:38.770147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:38.770272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:38.770585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:38.770877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:38.771286 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:38.771401 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:38.771787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:38.771917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:38.772216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:39.128622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:39.136645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:39.137213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b5d0d6cc-4241-4dac-9c91-f3e32361b0a0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.387970 Sep 11 10:54:39.152243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 442/864] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:38 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:39.152445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-313187bc-45d6-43ab-ba5a-b322f568f10f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1690 microversion: 2.1 time: 0.387370 Sep 11 10:54:39.152445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 423/865] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:38 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:39.210090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:39.210694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:39.217217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:39.217511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:39.217879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:39.218577 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:39.219021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:39.219667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:39.413372 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:39.423538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:39.424306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:39.425494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f46b992e-aac9-4085-9ed7-39264296e038 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1600 microversion: 2.20 time: 0.219286 Sep 11 10:54:39.426052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 443/866] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:54:39 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:54:39.451209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:39.451723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:39.457785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:39.458278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:39.458744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:39.459470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:39.459931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:39.460358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:39.584420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f6e839bd-be5a-4277-b985-bcbf37ce2dd6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136982 Sep 11 10:54:39.585023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 424/867] 10.222.0.15 () {60 vars in 1316 bytes} [Sun Sep 11 10:54:39 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:54:40.104729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153cc7c6-3af0-42a2-a57a-93a485f4905b", "name": "network-vif-deleted", "tag": "7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:40.115057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:40.115557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:40.115983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:40.159679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:40.161146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:40.168580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:40.169406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:40.170003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:40.171041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:40.171697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:40.172298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:40.301345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] Creating event network-vif-deleted:7aa7f1e9-dc44-4621-aa50-0d47fb7fccf0 for instance 153cc7c6-3af0-42a2-a57a-93a485f4905b on hv-cinder-85646 Sep 11 10:54:40.306281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-9422d3cf-85a4-4ebb-8169-fcfbb4b4b7e7 req-45ae9e29-7249-4d31-8767-fa6bd069a9e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205423 Sep 11 10:54:40.307135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 444/868] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:40.312046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:40.313179 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:40.319102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:40.319961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:40.320398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:40.321820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:40.322275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:40.322696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:40.342590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:40.663616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:40.673338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cb66366d-012f-4ccd-8596-b0f4b3a34914 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1623 microversion: 2.1 time: 0.364889 Sep 11 10:54:40.674835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 445/869] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:40 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1623 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:40.728786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:40.737322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-98e0e290-a595-4962-9ddf-d4aeac01d6a4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1265 microversion: 2.1 time: 0.582016 Sep 11 10:54:40.737896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 425/870] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:40 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1265 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:41.706155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:41.706682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:41.713503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.713983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.714411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.715102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.715579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.715995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.748085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.748567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.748993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.749430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'fault' on Instance uuid 153cc7c6-3af0-42a2-a57a-93a485f4905b {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:41.761582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:41.762184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:41.768784 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.769277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.769722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.770588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.771046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.771691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.793332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:41.801115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4c8337fa-b9ad-4358-8c8d-494246f12a80 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 200 len: 1335 microversion: 2.1 time: 0.098828 Sep 11 10:54:41.802219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 446/871] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:41 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:41.936034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:41.944864 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-263b35d1-5ea1-4b6c-bb12-30816e042ff9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1451 microversion: 2.1 time: 0.187411 Sep 11 10:54:41.946849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 426/872] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:41 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:54:41.969665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:41.970259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:41.976412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.977028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.977763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:41.978569 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:41.979017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:41.979455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:42.118558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:42.127280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6eaa27e9-b9bb-4285-847a-a74ece944ff4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1451 microversion: 2.1 time: 0.161399 Sep 11 10:54:42.128043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 447/873] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:41 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:42.345689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:42.356034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:42.356516 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:42.356938 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:42.370530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] Creating event network-changed:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:54:42.376588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-bb1810fa-28bb-45eb-bc1a-02bc2d7da128 req-9c894e30-a6e3-40e4-b9ce-1c9fc9f7046d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034478 Sep 11 10:54:42.377404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 427/874] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:42.826246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:42.826855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 153cc7c6-3af0-42a2-a57a-93a485f4905b] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:42.833272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:42.833758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:42.834196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:42.834895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:42.835356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:42.835806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:42.849653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] HTTP exception thrown: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Request method failure captured: Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b HTTP/1.1 Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyapJ6d7YaIKNmoRkGyG0j6dw_m_mO3dKCf5k-Boq5jePo2iEGW4FJQBwKwqxOV9xRFuJzzalZqmyX80rGwYB2MRfpmN-DbY-bNekyQezP1luSe-wYYdiBLMPxD4bwiH6vJK0p3S06ZJg7xritJMI7FPFoNLabXQPcf0tl3wshTV3Q Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:54:42.851313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_528ee82fc48247eea01a17898488ea3e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/528ee82fc48247eea01a17898488ea3e"}]}] Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f6eaba3a278e4bc99aca0dedd649fa9f Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. Sep 11 10:54:42.853934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '153cc7c6-3af0-42a2-a57a-93a485f4905b'} Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:54:42.854796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. Sep 11 10:54:42.856359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:42.858312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Returning 404 to user: Instance 153cc7c6-3af0-42a2-a57a-93a485f4905b could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:54:42.858312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-48da4099-02b1-4cb7-9847-d31897b204b9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b" status: 404 len: 111 microversion: 2.1 time: 0.031121 Sep 11 10:54:42.858312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 448/875] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:42 2022] GET /compute/v2.1/servers/153cc7c6-3af0-42a2-a57a-93a485f4905b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:54:42.862781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fd0f00dc-daeb-438c-93c7-8019eafb8ab5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '.version_select at 0x7f759bf33dc0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:42.883125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fd0f00dc-daeb-438c-93c7-8019eafb8ab5 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089391357" status: 202 len: 0 microversion: 2.1 time: 0.024523 Sep 11 10:54:42.883846 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 428/876] 10.222.0.15 () {58 vars in 1221 bytes} [Sun Sep 11 10:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089391357 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 10:54:44.406000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968c6bd3-170a-4e7f-9019-5d68db62c717", "tag": "a795b231-68a0-4b6a-a947-b5e2d3d47383"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:44.416881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:44.417351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:44.417778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:44.428584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] Creating event network-changed:a795b231-68a0-4b6a-a947-b5e2d3d47383 for instance 968c6bd3-170a-4e7f-9019-5d68db62c717 on hv-cinder-85646 Sep 11 10:54:44.433826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-8c81128a-df17-471f-bfec-17303ba6b171 req-9d50d4fa-9621-4602-bab7-ee93de89d0c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031422 Sep 11 10:54:44.434475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 449/877] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:45.817880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:45.818498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:45.820456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:45.826959 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:45.827466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:45.827909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:45.828598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:45.829051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:45.829473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:45.855054 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:54:45.928137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-86c174e2-d8da-4d6a-bc79-7a45f9a7499e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 204 len: 0 microversion: 2.1 time: 0.114363 Sep 11 10:54:45.928847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 429/878] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:54:45 2022] DELETE /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:54:45.937978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:45.938663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:45.944690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:45.945164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:45.945624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:45.946567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:45.947014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:45.947455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:46.079975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:46.089529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-669a4e95-776e-4a99-8720-266934375af0 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1509 microversion: 2.1 time: 0.156539 Sep 11 10:54:46.090090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 450/879] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:45 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:47.114213 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:47.114927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:47.121868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:47.122364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:47.122804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:47.123544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:47.124006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:47.124433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:47.296785 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:47.304519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1453de4a-1e07-48b6-b7d8-5f2e5047b099 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1509 microversion: 2.1 time: 0.195718 Sep 11 10:54:47.305078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 430/880] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:47 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:47.777751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d30882d-5494-46e8-947a-7e3594aff794", "name": "network-vif-deleted", "tag": "3454460f-90bb-469f-8e1b-684905656adc"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:47.787572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:47.788043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:47.788469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:47.799685 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] Creating event network-vif-deleted:3454460f-90bb-469f-8e1b-684905656adc for instance 0d30882d-5494-46e8-947a-7e3594aff794 on hv-cinder-85646 Sep 11 10:54:47.804500 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-20ce0afd-4aea-43e8-8ff9-ca37dfc1ac75 req-44f823f5-9cae-4f1a-9592-7d3021cb5e18 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031490 Sep 11 10:54:47.806048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 451/881] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:48.327981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:48.328627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:48.334933 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:48.335416 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:48.335880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:48.337392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:48.337874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:48.338302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:48.369908 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:48.370392 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:48.370824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:48.371270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'fault' on Instance uuid 0d30882d-5494-46e8-947a-7e3594aff794 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:48.412033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:48.419780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-af74a4f8-eaf5-470e-83d5-ab2362990228 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 200 len: 1312 microversion: 2.1 time: 0.096057 Sep 11 10:54:48.420337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 431/882] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:48 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:49.443158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:49.443905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: 0d30882d-5494-46e8-947a-7e3594aff794] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:49.450221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.450698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.451129 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.451844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.452294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.452713 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.468076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] HTTP exception thrown: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Request method failure captured: Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 HTTP/1.1 Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyapJ6d7YaIKNmoRkGyG0j6dw_m_mO3dKCf5k-Boq5jePo2iEGW4FJQBwKwqxOV9xRFuJzzalZqmyX80rGwYB2MRfpmN-DbY-bNekyQezP1luSe-wYYdiBLMPxD4bwiH6vJK0p3S06ZJg7xritJMI7FPFoNLabXQPcf0tl3wshTV3Q Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:54:49.469660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_528ee82fc48247eea01a17898488ea3e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/528ee82fc48247eea01a17898488ea3e"}]}] Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f6eaba3a278e4bc99aca0dedd649fa9f Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. Sep 11 10:54:49.471249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '0d30882d-5494-46e8-947a-7e3594aff794'} Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:54:49.472124 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. Sep 11 10:54:49.473744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:49.475316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Returning 404 to user: Instance 0d30882d-5494-46e8-947a-7e3594aff794 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:54:49.475316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8ce53b9a-126a-43bd-b112-5bbde6575cdf tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794" status: 404 len: 111 microversion: 2.1 time: 0.032600 Sep 11 10:54:49.475316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 452/883] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:49 2022] GET /compute/v2.1/servers/0d30882d-5494-46e8-947a-7e3594aff794 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:54:49.480383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:49.480867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:49.487612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.488097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.488533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.489224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.489683 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.490110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.514176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:54:49.588331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f2fd9b5b-69f6-4cd8-81ca-ce97052c24e9 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 204 len: 0 microversion: 2.1 time: 0.111925 Sep 11 10:54:49.588857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 432/884] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:54:49 2022] DELETE /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:54:49.597160 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:49.597801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:49.604712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.605201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.605644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.606347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:49.606805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:49.607232 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:49.736414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:49.744250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-74aff8d9-460c-4849-8006-46fd08edba0e tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.151012 Sep 11 10:54:49.744812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 453/885] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:49 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:50.768222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:50.769080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:50.776176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:50.776664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:50.777099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:50.777797 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:50.778248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:50.778668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:51.007770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:51.015409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9d06b8c3-6b1d-4797-a9df-64bef1356908 tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1522 microversion: 2.1 time: 0.251326 Sep 11 10:54:51.016277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 433/886] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:50 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:51.282793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc097091-fee3-409f-89ea-48aa3782c5f5", "name": "network-vif-deleted", "tag": "7f9eaa99-13c8-47df-80e2-26bdd82aecf6"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:54:51.295760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:51.296161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:51.296632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:51.310321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] Creating event network-vif-deleted:7f9eaa99-13c8-47df-80e2-26bdd82aecf6 for instance fc097091-fee3-409f-89ea-48aa3782c5f5 on hv-cinder-85646 Sep 11 10:54:51.316202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-6036fc34-bfa2-4e0d-9fc4-6b67e91ecee1 req-070b7f0a-faa1-444e-8504-e557b90e669e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037224 Sep 11 10:54:51.317498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 454/887] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:54:52.038342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:52.038952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:52.046422 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:52.046915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:52.047364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:52.048093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:52.048552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:52.048975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:52.080438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:52.080843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:52.081283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:52.081744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lazy-loading 'fault' on Instance uuid fc097091-fee3-409f-89ea-48aa3782c5f5 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:54:52.129669 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6eaba3a278e4bc99aca0dedd649fa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528ee82fc48247eea01a17898488ea3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:54:52.138744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-edbcb557-463d-4542-bcc1-30f915bbb96f tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 200 len: 1312 microversion: 2.1 time: 0.104326 Sep 11 10:54:52.139308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 434/888] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:52 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:54:53.163507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:54:53.164195 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] [instance: fc097091-fee3-409f-89ea-48aa3782c5f5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:54:53.171217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:53.171722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:53.172156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:53.172835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:54:53.173280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:54:53.173697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:54:53.187266 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] HTTP exception thrown: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Request method failure captured: Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 HTTP/1.1 Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyapJ6d7YaIKNmoRkGyG0j6dw_m_mO3dKCf5k-Boq5jePo2iEGW4FJQBwKwqxOV9xRFuJzzalZqmyX80rGwYB2MRfpmN-DbY-bNekyQezP1luSe-wYYdiBLMPxD4bwiH6vJK0p3S06ZJg7xritJMI7FPFoNLabXQPcf0tl3wshTV3Q Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:54:53.188949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/528ee82fc48247eea01a17898488ea3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_528ee82fc48247eea01a17898488ea3e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/528ee82fc48247eea01a17898488ea3e"}]}] Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 528ee82fc48247eea01a17898488ea3e Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-245853084 Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f6eaba3a278e4bc99aca0dedd649fa9f Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-245853084-project Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. Sep 11 10:54:53.190511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'fc097091-fee3-409f-89ea-48aa3782c5f5'} Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:54:53.191460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. Sep 11 10:54:53.192811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:54:53.194000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] Returning 404 to user: Instance fc097091-fee3-409f-89ea-48aa3782c5f5 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:54:53.194000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1f94f964-266c-4030-bb51-55c2800ac00c tempest-ServerRescueNegativeTestJSON-245853084 tempest-ServerRescueNegativeTestJSON-245853084-project] 10.222.0.15 "GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5" status: 404 len: 111 microversion: 2.1 time: 0.031550 Sep 11 10:54:53.194000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 455/889] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:54:53 2022] GET /compute/v2.1/servers/fc097091-fee3-409f-89ea-48aa3782c5f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:55:03.324008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-181097226"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:03.324570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:03.327207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:03.327889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:03.333383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:03.333867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:03.334309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:03.335010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:03.335482 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:03.335909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:03.461760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.network.security_group_api [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Removing security group 496e2c63-8576-4bc2-8d55-d21d1012bfb8 from port 2a7049ea-9e06-4c35-a607-a369f675a987 Sep 11 10:55:03.769207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-881c441e-52f2-4f38-bc1b-a002779b5224 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action" status: 202 len: 0 microversion: 2.1 time: 0.449374 Sep 11 10:55:03.769810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 435/890] 10.222.0.15 () {60 vars in 1278 bytes} [Sun Sep 11 10:55:03 2022] POST /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:55:03.778661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:03.785282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=33 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:03.786147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=40 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:03.789804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:03.791771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:03.792223 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:03.804443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] Creating event network-changed:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:55:03.810100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-f90d3621-c241-4124-a911-54d68c00e91f req-86129868-2f40-46a3-8aab-9cf002fce75e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036144 Sep 11 10:55:03.811054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 456/891] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:55:05.156203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:05.156832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:05.162881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:05.163370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:05.163827 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:05.164524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:05.164972 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:05.165557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:05.256507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lazy-loading 'services' on Instance uuid f8dd30d1-fad3-4a6e-95a8-4389a7752b0d {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:55:05.343473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b395f7dc-c578-480b-8dd8-a5fa41d84a99 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments/109e7e1b-cb7e-42ba-acb2-e1421edeadb0" status: 202 len: 0 microversion: 2.1 time: 0.191381 Sep 11 10:55:05.344575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 436/892] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:55:05 2022] DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments/109e7e1b-cb7e-42ba-acb2-e1421edeadb0 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 10:55:05.355183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:05.358548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:05.367270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:05.367838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:05.368785 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:05.369670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:05.370301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:05.370724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:05.411457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ccdbcb20-d2ac-4727-bc2e-611278b05e93 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061405 Sep 11 10:55:05.412108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 457/893] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:55:05 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:55:05.832225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:05.842278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:05.842774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:05.843211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:05.856220 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] Creating event network-changed:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:55:05.861522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-d5944a51-0a7c-463a-9165-1316e429ba1f req-10219a7f-be36-4e4e-97ce-427d87e6d941 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033251 Sep 11 10:55:05.862146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 437/894] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:06.425836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:06.428162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:06.434556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:06.435042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:06.435507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:06.436202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:06.436653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:06.437075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:06.466845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-df22ac59-ec7f-43fb-ba53-968aab416526 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Sep 11 10:55:06.467411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 458/895] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:55:06 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:07.480775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:07.482953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:07.490619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:07.491105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:07.491763 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:07.492457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:07.492906 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:07.493349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:07.522470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-bf8d44c0-5eac-4179-b3b2-5690729c2606 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047057 Sep 11 10:55:07.523025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 438/896] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:55:07 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:55:07.534748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:07.535270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:07.544356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:07.544837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:07.545264 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:07.545955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:07.546467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:07.547231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:07.624620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] HTTP exception thrown: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d is not attached to volume 109e7e1b-cb7e-42ba-acb2-e1421edeadb0 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Request method failure captured: Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments/109e7e1b-cb7e-42ba-acb2-e1421edeadb0 HTTP/1.1 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb2o70u6shQx5kmAO6Z3uV1Ho7uBRV-8gbjsBMLISJmK2dkPdo6DH36V1lIJVD6q0ndXjeX7IfgPeJ7KL3CkuvxOcMXbpozDj34OLNStSK3M01i3w1xGTBA7hsR3ctzU1cKt9YfHhmAASzqKvyzSgjg8ZmlKuWrihvCQHg_7ot155n0 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 73cbd4a12d444b0ba5d4c37d12f2ea49 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:55:07.637798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_73cbd4a12d444b0ba5d4c37d12f2ea49", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}] Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 73cbd4a12d444b0ba5d4c37d12f2ea49 Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-TestMinimumBasicScenario-1242423876-project Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 8902fe9b4ce54ad398422722101a947a Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-TestMinimumBasicScenario-1242423876-project Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:55:07.639382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d is not attached to volume 109e7e1b-cb7e-42ba-acb2-e1421edeadb0 Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'server_id': 'f8dd30d1-fad3-4a6e-95a8-4389a7752b0d', 'id': '109e7e1b-cb7e-42ba-acb2-e1421edeadb0'} Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 109e7e1b-cb7e-42ba-acb2-e1421edeadb0. Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:55:07.640288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d is not attached to volume 109e7e1b-cb7e-42ba-acb2-e1421edeadb0 Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d is not attached to volume 109e7e1b-cb7e-42ba-acb2-e1421edeadb0 Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:55:07.641673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Returning 404 to user: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d is not attached to volume 109e7e1b-cb7e-42ba-acb2-e1421edeadb0 {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:55:07.642852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9ba5efb2-75f5-40f3-9d5d-d92339c6f590 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments/109e7e1b-cb7e-42ba-acb2-e1421edeadb0" status: 404 len: 154 microversion: 2.1 time: 0.108516 Sep 11 10:55:07.642852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 459/897] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:55:07 2022] DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d/os-volume_attachments/109e7e1b-cb7e-42ba-acb2-e1421edeadb0 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 10:55:08.776772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:08.777286 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:08.783666 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:08.784153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:08.784649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:08.785351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:08.785808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:08.786236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:08.813971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:55:08.885856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e8aeaff7-b409-43c8-963d-2f3ab0105a5c tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 204 len: 0 microversion: 2.1 time: 0.112698 Sep 11 10:55:08.886445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 439/898] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:55:08 2022] DELETE /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:55:08.894806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:08.895417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:08.902385 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:08.902868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:08.903351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:08.904074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:08.904529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:08.904957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:09.036094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:09.044330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-06f55b93-4b63-4b33-a521-326db13c6796 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1556 microversion: 2.1 time: 0.153353 Sep 11 10:55:09.044887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 460/899] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:08 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:10.067368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:10.068068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:10.074714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:10.075198 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:10.075664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:10.076357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:10.076806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:10.077225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:10.212363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:10.220314 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1899be88-4df6-4d63-8df4-1eb61693f325 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1556 microversion: 2.1 time: 0.157163 Sep 11 10:55:10.220874 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 440/900] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:10 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:11.245405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:11.246159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:11.252599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:11.253080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:11.253513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:11.254197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:11.254644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:11.255071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:11.469156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:11.476996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6906ef6c-dd96-4b38-a1f7-c3a915839f3f tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1556 microversion: 2.1 time: 0.236063 Sep 11 10:55:11.477562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 461/901] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:11 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:11.796372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd30d1-fad3-4a6e-95a8-4389a7752b0d", "name": "network-vif-deleted", "tag": "2a7049ea-9e06-4c35-a607-a369f675a987"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:11.807383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:11.807872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:11.808376 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:11.819662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] Creating event network-vif-deleted:2a7049ea-9e06-4c35-a607-a369f675a987 for instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d on hv-cinder-85646 Sep 11 10:55:11.825092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-d8fa4865-1445-4c3e-995a-5603449b1a51 req-01c22cc4-a983-4d6d-8f7a-ba743064ecd8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Sep 11 10:55:11.825717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 441/902] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:12.501068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:12.501820 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:12.509010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:12.510191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:12.510841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:12.511556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:12.512165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:12.512743 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:12.547790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:12.548607 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:12.549046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:12.549495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lazy-loading 'fault' on Instance uuid f8dd30d1-fad3-4a6e-95a8-4389a7752b0d {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:55:12.596833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8902fe9b4ce54ad398422722101a947a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cbd4a12d444b0ba5d4c37d12f2ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:12.611687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e9e2a7c6-23b1-495c-846f-2e8ebb995025 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 200 len: 1349 microversion: 2.1 time: 0.114346 Sep 11 10:55:12.612276 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 462/903] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:12 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 1349 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:13.638508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:13.639202 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] [instance: f8dd30d1-fad3-4a6e-95a8-4389a7752b0d] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:13.645318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:13.645801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:13.646234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:13.646919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:13.647369 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:13.647817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:13.661076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] HTTP exception thrown: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Request method failure captured: Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d HTTP/1.1 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb2o70u6shQx5kmAO6Z3uV1Ho7uBRV-8gbjsBMLISJmK2dkPdo6DH36V1lIJVD6q0ndXjeX7IfgPeJ7KL3CkuvxOcMXbpozDj34OLNStSK3M01i3w1xGTBA7hsR3ctzU1cKt9YfHhmAASzqKvyzSgjg8ZmlKuWrihvCQHg_7ot155n0 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 73cbd4a12d444b0ba5d4c37d12f2ea49 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:55:13.662777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_73cbd4a12d444b0ba5d4c37d12f2ea49", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/73cbd4a12d444b0ba5d4c37d12f2ea49"}]}] Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 73cbd4a12d444b0ba5d4c37d12f2ea49 Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1242423876 Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-TestMinimumBasicScenario-1242423876-project Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 8902fe9b4ce54ad398422722101a947a Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-TestMinimumBasicScenario-1242423876-project Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. Sep 11 10:55:13.664378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'f8dd30d1-fad3-4a6e-95a8-4389a7752b0d'} Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:55:13.665294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. Sep 11 10:55:13.667098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:13.668334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Returning 404 to user: Instance f8dd30d1-fad3-4a6e-95a8-4389a7752b0d could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:55:13.668334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2c22e719-321e-46f4-a304-bb6b2a4ac554 tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d" status: 404 len: 111 microversion: 2.1 time: 0.031270 Sep 11 10:55:13.668334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 442/904] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:13 2022] GET /compute/v2.1/servers/f8dd30d1-fad3-4a6e-95a8-4389a7752b0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:55:13.672911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-993b76c2-698b-4bea-b187-e1eb9874d57a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] Calling method '.version_select at 0x7f759bf23700>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:13.692068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-993b76c2-698b-4bea-b187-e1eb9874d57a tempest-TestMinimumBasicScenario-1242423876 tempest-TestMinimumBasicScenario-1242423876-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1529275444" status: 202 len: 0 microversion: 2.1 time: 0.022868 Sep 11 10:55:13.692885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 463/905] 10.222.0.15 () {58 vars in 1272 bytes} [Sun Sep 11 10:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1529275444 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:55:19.974485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:19.975241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:19.984472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:19.985125 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:19.985572 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:19.986465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:19.987089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:19.987689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:20.024293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5c920dd5-86ae-4bfd-84bf-fa4d3e3f115a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058431 Sep 11 10:55:20.037079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 443/906] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:55:19 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:55:20.125559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:20.126133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:20.140329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:20.141094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:20.142224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:20.143651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:20.144342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:20.144872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:20.175164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:55:20.264438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b8ecd648-3911-4f33-9842-06ae0ef89482 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 204 len: 0 microversion: 2.1 time: 0.142115 Sep 11 10:55:20.267518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 464/907] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:55:20 2022] DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:55:20.275375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:20.276239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:20.290754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:20.291698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:20.292418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:20.293984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:20.294799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:20.295534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:20.472494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:20.482199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c07ebcd9-8ab1-4902-b142-ce0c5464b7fc tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1674 microversion: 2.1 time: 0.212479 Sep 11 10:55:20.483036 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 444/908] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:20 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:21.507070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:21.508206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:21.519089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:21.520095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:21.521479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:21.522821 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:21.523686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:21.523998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:21.686125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:21.694189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-71125b40-95d0-4975-af3d-5de0d4d4ff31 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1674 microversion: 2.1 time: 0.191591 Sep 11 10:55:21.694759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 465/909] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:21 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:22.718274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:22.718883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:22.726779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:22.727268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:22.728480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:22.729383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:22.730000 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:22.730586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:22.974523 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:22.982749 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e78d84a9-e499-4d1f-8ad8-3e0b06d3b1ba tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 200 len: 1674 microversion: 2.1 time: 0.268349 Sep 11 10:55:22.983697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 445/910] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:22 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 1674 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:23.218905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936f747a-7ced-4807-a2fe-72d35d9b9b20", "name": "network-vif-deleted", "tag": "bac56ec2-e7e9-458f-954f-675340feff36"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:23.238163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:23.238847 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:23.239622 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:23.259585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] Creating event network-vif-deleted:bac56ec2-e7e9-458f-954f-675340feff36 for instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 on hv-cinder-85646 Sep 11 10:55:23.267216 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-bc534221-2706-4ff3-8e4c-098ce6819ee9 req-7424cbe4-53e8-4bcd-a3e5-66f02e76966c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052497 Sep 11 10:55:23.268518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 466/911] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:24.010978 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:24.011828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:24.019901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:24.020390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:24.020828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:24.021539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:24.022001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:24.022439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:24.036767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 HTTP/1.1 Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:55:24.038049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:55:24.039802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '936f747a-7ced-4807-a2fe-72d35d9b9b20'} Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:55:24.041359 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:55:24.043249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:55:24.044686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:55:24.044686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f836b54b-46cb-4da6-bab3-545c4c801d28 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 404 len: 111 microversion: 2.1 time: 0.036913 Sep 11 10:55:24.044686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 446/912] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:24 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:55:24.049945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-695ea81e-3377-4961-a3e6-9f1cdf98112e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '.version_select at 0x7f759bf23310>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:24.070695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-695ea81e-3377-4961-a3e6-9f1cdf98112e tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832666301" status: 202 len: 0 microversion: 2.1 time: 0.024901 Sep 11 10:55:24.071979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 467/913] 10.222.0.15 () {58 vars in 1221 bytes} [Sun Sep 11 10:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832666301 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:55:24.771515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8c9f6597-e739-421c-ba8f-029072d196e6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: .version_select at 0x7f759bf7fdc0>, body: {"keypair": {"name": "tempest-keypair-1420905176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7izjSE4tH/zI83awP7sqs0C2lkrStAa0EgGWlE2IqduvgRhlVq7aO4U8YsB96Grcq1ik9AxDtvcg327oujn3DFaXoOEAH6hZrxZ/8/AvOYu/3G1qIlaf2RmcUOoWnOTw=="}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:24.787239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-8c9f6597-e739-421c-ba8f-029072d196e6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:55:24.791727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-8c9f6597-e739-421c-ba8f-029072d196e6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for user 8d0af2b5f354439d92bfa317a0baefd5 and project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:55:24.813987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8c9f6597-e739-421c-ba8f-029072d196e6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046285 Sep 11 10:55:24.814579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 447/914] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:55:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:26.218104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1498052145", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bfe408-3793-49e5-b0a4-b09176d5b63d"}], "security_groups": [{"name": "tempest-securitygroup--1292322017"}], "key_name": "tempest-keypair-1420905176", "user_data": "}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:26.338880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] validate_networks() for [('d8bfe408-3793-49e5-b0a4-b09176d5b63d', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:55:26.720885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:55:26.721306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:55:26.721773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:55:26.722174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:55:26.722578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:55:26.732106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:26.732591 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:26.733099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:26.733818 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:26.734516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:26.734942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:26.753804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:55:26.757814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Getting quotas for user 8d0af2b5f354439d92bfa317a0baefd5 and project 204ecef1ba96491cbfb3e8176e6c22ec. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:55:26.769324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:55:26.771756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:55:26.820419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-25206530-0272-456f-bbe8-51822a49e912 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608277 Sep 11 10:55:26.821825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 468/915] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:55:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:55:26.833290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c0a0cba-07ce-4184-88c6-72e838db9a93 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:26.833893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2c0a0cba-07ce-4184-88c6-72e838db9a93 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:26.918313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2c0a0cba-07ce-4184-88c6-72e838db9a93 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:26.931916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2c0a0cba-07ce-4184-88c6-72e838db9a93 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1238 microversion: 2.1 time: 0.101914 Sep 11 10:55:26.932662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 448/916] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:26 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:27.955449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:27.956052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:27.963530 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:27.963998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:27.964432 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:27.965125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:27.965573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:27.966043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:28.071712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:28.081098 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fff38705-2094-4c8f-9b57-c18d9af39fa9 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1298 microversion: 2.1 time: 0.129927 Sep 11 10:55:28.081865 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 469/917] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:27 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:29.107292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:29.108589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:29.116634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:29.118026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:29.118807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:29.120011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:29.120854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:29.121510 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:29.336273 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:29.345190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a7db332b-b051-4d16-8379-dac22c3f00be tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.243336 Sep 11 10:55:29.345756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 449/918] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:29 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:55:29.701153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd20dd85-8203-422c-97ac-d860f7d1d482", "tag": "c040b419-e395-41a7-b4c7-032d5bb7d993"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:29.714492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:29.715168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:29.716033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:29.730587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] Creating event network-changed:c040b419-e395-41a7-b4c7-032d5bb7d993 for instance dd20dd85-8203-422c-97ac-d860f7d1d482 on hv-cinder-85646 Sep 11 10:55:29.737391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-b6450e68-b545-4d32-97d9-9bbbf733556f req-abb4bb33-8fbd-48db-a809-a66d4e3b0066 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042492 Sep 11 10:55:29.738608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 470/919] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:30.369909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:30.370530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:30.376947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:30.377439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:30.377878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:30.378578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:30.379035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:30.379475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:30.585474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:30.593907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3defd41e-9e4a-4245-9d23-43d27ac138cb tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.228441 Sep 11 10:55:30.594494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 450/920] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:30 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:31.617455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:31.618677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:31.625197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:31.625674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:31.626102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:31.626809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:31.627252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:31.627692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:31.761075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:31.768648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6f3db051-64fc-449f-8676-5d85d40e8f0b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.155489 Sep 11 10:55:31.769207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 471/921] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:31 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:32.791610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:32.792252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:32.798699 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:32.799189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:32.799661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:32.800351 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:32.800809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:32.801238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:32.929591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:32.938021 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e44eccbe-7fb4-4f6a-8376-da8eca5411a1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.150447 Sep 11 10:55:32.938574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 451/922] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:32 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:33.962917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:33.963677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:33.966345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:33.972155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:33.972718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:33.973217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:33.973983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:33.974428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:33.974985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:33.981664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:34.153647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:34.161646 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-070d5cfd-ab88-4550-bd9c-024cf1f3e492 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.203619 Sep 11 10:55:34.162219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 472/923] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:33 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:35.185010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:35.185692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:35.188349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:35.195068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:35.195625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:35.196309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:35.197724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:35.198199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:35.198640 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:35.203596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:35.409301 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:35.418442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c0196d98-d628-451f-a6bf-73792c8f9277 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.237419 Sep 11 10:55:35.419018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 452/924] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:35 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:36.197666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd20dd85-8203-422c-97ac-d860f7d1d482", "name": "network-vif-plugged", "status": "completed", "tag": "c040b419-e395-41a7-b4c7-032d5bb7d993"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:36.218112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:36.218882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:36.219573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:36.234968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] Creating event network-vif-plugged:c040b419-e395-41a7-b4c7-032d5bb7d993 for instance dd20dd85-8203-422c-97ac-d860f7d1d482 on hv-cinder-85646 Sep 11 10:55:36.240336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-5887a08b-cbda-4917-8aa6-7737c95d2438 req-35681153-bbd3-4a80-aab7-d18b46d21f17 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046685 Sep 11 10:55:36.241102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 473/925] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:36.441489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:36.442210 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:36.448403 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:36.449030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:36.449544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:36.450320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:36.450843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:36.451340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:36.834821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:36.843048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d0c5e9fb-09f9-4a3b-b0d1-eb4983f9222a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.405457 Sep 11 10:55:36.843626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 453/926] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:36 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:37.378235 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:37.379084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:37.384394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-780614220", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "networks": [{"uuid": "f5bd004a-0b1d-4f2b-93a8-0e6a1eed2718"}]}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:37.436829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] validate_networks() for [('f5bd004a-0b1d-4f2b-93a8-0e6a1eed2718', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:55:37.781009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:55:37.781424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:55:37.781886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:55:37.782283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:55:37.782683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:55:37.791397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:37.791896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:37.792329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:37.793044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:37.793489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:37.793905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:37.810389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Getting quotas for project 80459f77fe204aefb516e8389f1458fc. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:55:37.814631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Getting quotas for user fc2f971c8c4d47f59c79495289e59112 and project 80459f77fe204aefb516e8389f1458fc. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:55:37.826009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:55:37.828411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:55:37.866263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:37.866875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:37.868778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:37.874430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-78beef2d-2ec2-4610-a712-66cfab8dc04c tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497046 Sep 11 10:55:37.880881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 474/927] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:55:37.881034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:37.881034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:37.881034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:37.881034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:37.881412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:37.881412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:37.886626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-130556dd-dfc1-48d3-8da7-4f016c7f2e93 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:37.887299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-130556dd-dfc1-48d3-8da7-4f016c7f2e93 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:37.976758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-130556dd-dfc1-48d3-8da7-4f016c7f2e93 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:37.985874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-130556dd-dfc1-48d3-8da7-4f016c7f2e93 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1218 microversion: 2.1 time: 0.103793 Sep 11 10:55:38.000430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 475/928] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:37 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:38.043609 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:38.051670 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-de82dccd-f039-45f2-878c-7079fd3d5ca6 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1364 microversion: 2.1 time: 0.189395 Sep 11 10:55:38.052222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 454/929] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:37 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:39.009766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:39.010395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:39.017342 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.017832 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.018272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.018973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.019445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.019894 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.075285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:39.075950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:39.081322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:39.082428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.082922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.083362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.084099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.084560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.084991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.089345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96789b5c-dcf2-424b-b109-14b405bfc8f7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1270 microversion: 2.1 time: 0.084250 Sep 11 10:55:39.089904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 476/930] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:39 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:39.214373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:39.221945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7c98fde4-b4ea-4f9e-ae46-21be04649ad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1550 microversion: 2.1 time: 0.151138 Sep 11 10:55:39.222504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 455/931] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:39 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:55:39.245405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:39.245821 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:39.252014 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.252502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.252938 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.253669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:39.254123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:39.254564 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:39.335732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-624bc887-ce03-41d2-be9c-fb258d3257fd tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094742 Sep 11 10:55:39.336943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 477/932] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 10:55:39 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:40.112578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:40.113108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:40.120185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:40.120673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:40.121110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:40.121813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:40.122453 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:40.122875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:40.231491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:40.240104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-62277c35-3153-49f7-8615-4d8c86c5876a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1276 microversion: 2.1 time: 0.131794 Sep 11 10:55:40.241006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 456/933] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:40 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:41.112034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd20dd85-8203-422c-97ac-d860f7d1d482", "tag": "c040b419-e395-41a7-b4c7-032d5bb7d993"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:41.122608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:41.123173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:41.123702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:41.136272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] Creating event network-changed:c040b419-e395-41a7-b4c7-032d5bb7d993 for instance dd20dd85-8203-422c-97ac-d860f7d1d482 on hv-cinder-85646 Sep 11 10:55:41.141279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-dd27170b-55cf-4162-a21a-d00b51729348 req-924896ae-0773-4e8a-8376-a3b32c93c1f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033328 Sep 11 10:55:41.141955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 478/934] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:41.264217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:41.264830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:41.271642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:41.272135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:41.272571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:41.273277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:41.274956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:41.275400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:41.605717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:41.614158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-45bf0340-ff0d-41d4-9168-4823d4ec71c4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.353821 Sep 11 10:55:41.614819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 457/935] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:41 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:42.638979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:42.639768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:42.646327 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:42.646807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:42.647244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:42.647957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:42.648405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:42.649382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:42.780657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:42.788228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a2652a31-f049-40f7-b965-949376905c51 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.154131 Sep 11 10:55:42.788787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 479/936] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:42 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:43.156105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9b043b-ed7b-4314-80a7-e26ef3d01f15", "tag": "b1a0ef4d-8c84-4cf7-8752-8178ece35043"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:43.166676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:43.167148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:43.167620 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:43.177991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] Creating event network-changed:b1a0ef4d-8c84-4cf7-8752-8178ece35043 for instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 on hv-cinder-85646 Sep 11 10:55:43.183829 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-a2774590-5003-4343-b638-55c9f7344cfa req-74856920-b3d0-4d5e-bdb8-167e9b803d65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031225 Sep 11 10:55:43.184710 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 458/937] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:43.811946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:43.812623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:43.819354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:43.819867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:43.820299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:43.821629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:43.822084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:43.822508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:43.955680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:43.963943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-02ba26f5-a1a9-4412-b820-a147aa56377e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.156147 Sep 11 10:55:43.964508 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 480/938] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:43 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:44.994257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:44.994936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:45.001063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:45.001548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:45.001986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:45.002679 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:45.003138 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:45.003595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:45.138645 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:45.146357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d56f2483-c1ef-41d6-8aef-6c802645b3ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.163596 Sep 11 10:55:45.147141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 459/939] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:44 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:46.170197 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:46.171597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:46.177853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:46.178324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:46.178750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:46.179614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:46.180013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:46.181060 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:46.318078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:46.326659 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fe31cc7a-df30-4d7b-95e8-e9ac49a5b4dd tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.160475 Sep 11 10:55:46.327207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 481/940] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:46 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:47.349414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:47.350041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:47.356219 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:47.356721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:47.357154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:47.357845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:47.358302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:47.358755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:47.487841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:47.496204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-729d90ca-5f20-43a3-86cf-541a5068f76e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.150630 Sep 11 10:55:47.496767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 460/941] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:47 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:48.254730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9b043b-ed7b-4314-80a7-e26ef3d01f15", "name": "network-vif-plugged", "status": "completed", "tag": "b1a0ef4d-8c84-4cf7-8752-8178ece35043"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:55:48.261132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:48.261798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=8 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:48.267853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:48.268410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:48.268835 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:48.281297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] Creating event network-vif-plugged:b1a0ef4d-8c84-4cf7-8752-8178ece35043 for instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 on hv-cinder-85646 Sep 11 10:55:48.286384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-8cb709d0-16d3-4095-9c95-180f8ba6a13e req-ceefabc5-7f58-4b21-803b-64522d9cc1ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 Sep 11 10:55:48.287237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 482/942] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:55:48.519083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:48.519723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:48.527101 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:48.527634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:48.528069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:48.528774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:48.529225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:48.529647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:48.660787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:48.668352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-10f781d9-150c-426e-bc39-42d3f54d142a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.153075 Sep 11 10:55:48.668904 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 461/943] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:48 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:49.692660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:49.693297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:49.699455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:49.699955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:49.700390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:49.701076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:49.701557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:49.701983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:49.831326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:49.840115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-77eb8034-c281-4556-a630-15663bcdac94 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1318 microversion: 2.1 time: 0.152241 Sep 11 10:55:49.841225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 483/944] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:49 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:55:50.862823 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:55:50.863464 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:55:50.870576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:50.871071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:50.871548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:50.872254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:55:50.872714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:55:50.873145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:55:51.002924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:55:51.010918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f972358a-7d39-47c8-bbb9-5547cc9c92fe tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1508 microversion: 2.1 time: 0.152100 Sep 11 10:55:51.011486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 462/945] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:55:50 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:04.100344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:04.102114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:04.102631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:04.105286 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:04.107375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=47 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:04.111391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=21 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:04.111747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=61 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:04.113059 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:04.113571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:04.114126 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:04.114801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:04.115270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:04.115796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:04.116504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:04.116961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:04.117881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:04.130305 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] Creating event network-changed:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:56:04.135625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-13fe9471-d2c8-43dc-98fb-e059ff93feac req-ba7de4c6-e5d9-4b8a-914a-c9864c281387 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038849 Sep 11 10:56:04.136624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 463/946] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:56:04.145619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:56:04.226884 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6e420269-f59a-42f7-8b03-05d1e88e0f7a tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 204 len: 0 microversion: 2.1 time: 0.133185 Sep 11 10:56:04.228507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 484/947] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:56:04 2022] DELETE /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:56:04.240031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:04.240799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:04.247724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:04.248248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:04.248686 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:04.249390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:04.249845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:04.250270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:04.387508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:04.395958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6adf8cf9-10fd-4cca-a731-2bd89f92ff41 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.161379 Sep 11 10:56:04.396522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 464/948] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:04 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:56:05.420682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:05.421299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:05.427682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:05.428163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:05.428593 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:05.429279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:05.429729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:05.430147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:05.563221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:05.570885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6af439e9-a352-4129-ab8d-944cb81b66a3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.155160 Sep 11 10:56:05.571461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 485/949] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:05 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:06.595515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:06.596124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:06.602528 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:06.603007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:06.603457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:06.604141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:06.604589 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:06.605009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:06.741119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:06.748895 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-76a06218-0879-40d9-aadf-bf931c3781fd tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1569 microversion: 2.1 time: 0.157295 Sep 11 10:56:06.749452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 465/950] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:06 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:07.252292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4", "name": "network-vif-deleted", "tag": "8fbd63e5-0224-4e75-82b1-daab49049cf3"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:07.262807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:07.263397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:07.263859 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:07.274905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] Creating event network-vif-deleted:8fbd63e5-0224-4e75-82b1-daab49049cf3 for instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 on hv-cinder-85646 Sep 11 10:56:07.282953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-1b0c1a51-a8f6-461c-97bf-ee2bd6153b80 req-9528e82a-ab09-48f6-8e69-d80cfcddc9f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Sep 11 10:56:07.283751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 486/951] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:56:07.771139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:07.771779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:07.778685 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:07.779170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:07.779719 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:07.780417 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:07.780872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:07.781295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:07.849974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839e78f400a46eb916b51c9e257bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587882642889489587749d5fb846acc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:07.863050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-596f8b57-591b-4336-a6a4-b04096cb2920 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 200 len: 1219 microversion: 2.1 time: 0.095689 Sep 11 10:56:07.863826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 466/952] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:07 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:08.890683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:08.891378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] [instance: f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:08.897625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:08.898106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:08.898540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:08.899229 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:08.899708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:08.900135 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:08.918078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] HTTP exception thrown: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Request method failure captured: Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 HTTP/1.1 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb1D8wp6GvAcZVUyC_TJTSpCw_HCVWHKfchZDe2ZUK8R_2o-f_dznf4ps5fd18y_yJj8gle736udPYiXFewYnqk23MZNVk6DaVdvHZJf7YINTkzhVMkfFMUBXoBfh4r9KfowlIIzMAgVMs9fZ2EO8xLVWs9nPfsO7qXLz0M0DyNqj1o Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 587882642889489587749d5fb846acc6 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-TestShelveInstance-1213152103 Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:56:08.919745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/587882642889489587749d5fb846acc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/587882642889489587749d5fb846acc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_587882642889489587749d5fb846acc6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/587882642889489587749d5fb846acc6"}]}] Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-TestShelveInstance-1213152103 Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 587882642889489587749d5fb846acc6 Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-TestShelveInstance-1213152103 Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-TestShelveInstance-1213152103-project Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e839e78f400a46eb916b51c9e257bdf1 Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-TestShelveInstance-1213152103-project Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. Sep 11 10:56:08.922109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4'} Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:56:08.923043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. Sep 11 10:56:08.925366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:56:08.927215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Returning 404 to user: Instance f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:56:08.927215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-afe70020-5976-4e84-9f5d-608d9a0e3d52 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4" status: 404 len: 111 microversion: 2.1 time: 0.035732 Sep 11 10:56:08.927215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 487/953] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:08 2022] GET /compute/v2.1/servers/f3612f3d-c75a-477a-8dd3-b9eaa53ce6a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:56:09.079919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-450ce482-c29f-4bf4-8c7f-bc96b982c5d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] Calling method '.version_select at 0x7f75a37d43a0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:09.102278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-450ce482-c29f-4bf4-8c7f-bc96b982c5d3 tempest-TestShelveInstance-1213152103 tempest-TestShelveInstance-1213152103-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905934699" status: 202 len: 0 microversion: 2.1 time: 0.026834 Sep 11 10:56:09.106566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 467/954] 10.222.0.15 () {58 vars in 1251 bytes} [Sun Sep 11 10:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905934699 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:56:11.563091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:11.563687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:11.569397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:11.569877 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:11.570306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:11.570991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:11.571455 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:11.571878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:11.595606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c97c47b9-3cce-4b3a-88cd-7fb065f301ee tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/ips" status: 200 len: 152 microversion: 2.20 time: 0.037734 Sep 11 10:56:11.596182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 488/955] 10.222.0.15 () {60 vars in 1289 bytes} [Sun Sep 11 10:56:11 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:56:14.579218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:14.579890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:14.586576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:14.587065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:14.587539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:14.588239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:14.588696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:14.589123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:14.613318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lazy-loading 'flavor' on Instance uuid 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:56:14.842678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6449db96-fb33-43d1-a651-21db7ada7e8a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/action" status: 202 len: 0 microversion: 2.20 time: 0.267750 Sep 11 10:56:14.844070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 468/956] 10.222.0.15 () {62 vars in 1319 bytes} [Sun Sep 11 10:56:14 2022] POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:56:14.852552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:14.853148 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:14.860457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:14.860949 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:14.861501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:14.862334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:14.862817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:14.863242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:15.071324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:15.082423 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:15.083967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:15.085285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9af04f3c-7934-4bf4-877f-0c4a62be0c1e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.236791 Sep 11 10:56:15.101909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 489/957] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:14 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:56:16.116264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:16.117012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:16.124229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:16.124852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:16.125150 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:16.125982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:16.126306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:16.126734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:16.268515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:16.277233 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:16.278674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:16.280531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e8724ac0-ca9f-492a-8cf3-d5dea68b92b6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.169406 Sep 11 10:56:16.281299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 469/958] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:16 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:16.800573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "032ef2d4-7e1b-4ec6-a14e-df98ade1e274", "device": "/dev/sdb"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:16.803643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:16.810048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:16.810585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:16.811017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:16.811922 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:16.812385 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:16.812826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:17.068844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a46abe21-ce18-48b4-ab8c-5180aef67f92 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "POST /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271766 Sep 11 10:56:17.069443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 490/959] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:56:16 2022] POST /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:56:17.306471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:17.307299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:17.315367 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:17.316398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:17.316872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:17.317576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:17.318052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:17.318477 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:17.447704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:17.456577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:17.458006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:17.459155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-24351a0b-b032-4cc6-8bb1-77974cb1f600 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.157020 Sep 11 10:56:17.459739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 470/960] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:17 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:18.485940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:18.486525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:18.494690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:18.495183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:18.495653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:18.496364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:18.496813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:18.497233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:18.647667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:18.657470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:18.658893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:18.660215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f80f907e-823f-400d-8459-97416dbda61c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.179688 Sep 11 10:56:18.660850 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 491/961] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:18 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:56:19.685849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:19.686495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:19.692855 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:19.693342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:19.693782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:19.694475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:19.694929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:19.695360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:19.824851 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:19.833696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:19.835130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:19.836320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b91642c4-1fda-44e8-aeb7-4c56597618dd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.154783 Sep 11 10:56:19.836868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 471/962] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:19 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:20.861637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:20.862509 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:20.869015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:20.869486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:20.869914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:20.870590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:20.871033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:20.871467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:21.005415 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:21.013408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:21.015393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:21.016579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f1a41ade-e12a-47e8-b4a1-7cd68573d97c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.159480 Sep 11 10:56:21.017131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 492/963] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:20 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:22.042085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:22.042692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:22.049388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:22.049865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:22.050298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:22.050984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:22.051452 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:22.051872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:22.180072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:22.188008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:22.190566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:22.191769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cd36b7e4-eff1-4095-9e1d-20217ecdf65c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.153533 Sep 11 10:56:22.192327 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 472/964] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:22 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:23.217498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:23.218112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:23.227348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:23.227866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:23.228306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:23.229005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:23.229457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:23.229882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:23.361834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:23.370009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:23.371465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:23.372629 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d11fd5dc-e64a-48ca-9167-af87c4d3a065 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.159134 Sep 11 10:56:23.373180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 493/965] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:23 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:24.398133 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:24.398781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:24.405134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:24.405611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:24.406041 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:24.407256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:24.408022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:24.408460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:24.536337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:24.544444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:24.545887 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:24.547077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-707ea85f-ca4f-41d4-9710-808955dc6aa7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.152883 Sep 11 10:56:24.547793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 473/966] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:24 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:25.571465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:25.572102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:25.578696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:25.579255 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:25.579802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:25.580496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:25.580951 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:25.581374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:25.710282 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:25.718943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:25.720911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:25.722067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96c653fc-e48e-4ac1-9506-92e2bf16b076 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.154605 Sep 11 10:56:25.722618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 494/967] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:25 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:26.747534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:26.748145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:26.755608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:26.756095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:26.756533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:26.757226 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:26.757681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:26.758104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:26.891988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:26.900022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:26.901436 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:26.902570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-632a08d9-8c83-4301-bfa9-1cbe7987c374 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.158972 Sep 11 10:56:26.903114 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 474/968] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:26 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:27.928060 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:27.928657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:27.935046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:27.935555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:27.935992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:27.936677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:27.937156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:27.937575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:28.063150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:28.071755 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:28.073187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:28.074344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-801ef498-a253-461c-947a-2ffc4d34fad7 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.150902 Sep 11 10:56:28.074925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 495/969] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:27 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:29.100399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:29.101039 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:29.107500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:29.107995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:29.108435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:29.109132 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:29.109867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:29.110294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:29.246204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:29.254409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:29.255868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:29.257026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e4452599-e568-4b6c-aa16-b187c6439d6a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.161137 Sep 11 10:56:29.257575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 475/970] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:29 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:30.285296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:30.285893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:30.292244 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:30.292720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:30.293144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:30.293826 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:30.294271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:30.294688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:30.428021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:30.435953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:30.437395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:30.438535 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3233ad8e-5e09-4a00-9e46-4fdce8f5784d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.157779 Sep 11 10:56:30.439078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 496/971] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:30 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:31.463245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:31.463900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:31.470228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:31.470709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:31.471146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:31.471858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:31.472311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:31.472736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:31.600947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:31.608936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:31.610619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:31.612540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1331b7df-3c72-408c-9a91-2abc6820a794 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.153157 Sep 11 10:56:31.613092 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 476/972] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:31 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:32.637787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:32.638392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:32.645691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:32.646172 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:32.646606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:32.647295 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:32.647769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:32.648192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:32.778438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:32.786442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:32.787900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:32.789052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8ede90b3-3477-4eaf-b153-61c217207999 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.155232 Sep 11 10:56:32.789605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 497/973] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:32 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:33.817295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:33.817905 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:33.824376 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:33.824863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:33.825302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:33.825995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:33.826451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:33.826878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:33.953799 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:33.962519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:33.963976 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:33.965131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b41572d4-8727-4be2-a456-f8c234e9cf96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.153147 Sep 11 10:56:33.965688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 477/974] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:33 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:34.990263 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:34.990873 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:34.993257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:34.999512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:34.999993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:35.000430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:35.001117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:35.001567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:35.002168 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:35.006637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:35.136715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:35.145305 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:35.146739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:35.147929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3088717f-bc67-4fda-8268-0dae5ae1eec4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.161788 Sep 11 10:56:35.148474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 498/975] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:34 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:36.173637 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:36.175106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:36.177502 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:36.182704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:36.183186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:36.183644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:36.184330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:36.184783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:36.185203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:36.188574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:36.322162 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:36.330374 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:36.331850 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:36.333019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5db1e2b1-006f-42b4-bb93-57b062235db4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.163385 Sep 11 10:56:36.333577 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 478/976] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:36 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:37.358490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:37.359090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:37.366383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:37.366853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:37.367283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:37.367989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:37.368437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:37.368853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:37.717798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:37.726292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:37.727754 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:37.728916 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e9ff5753-2fcb-4447-a103-3548bfcde8f6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.374393 Sep 11 10:56:37.729485 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 499/977] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:37 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:38.755093 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:38.755738 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:38.762540 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:38.763058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:38.763519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:38.764221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:38.764678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:38.765101 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:38.784918 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "name": "network-vif-plugged", "status": "completed", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:38.795046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:38.795914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:38.796592 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:38.811075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] Creating event network-vif-plugged:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:56:38.817312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-b0b97ab6-80be-40ed-b172-9e9e4ed35796 req-8d6b01b9-0864-4ed0-8c85-3e845e17ac58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Sep 11 10:56:38.817983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 500/978] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:56:38.954491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:38.962698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:38.964166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:38.965353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-441a7a6d-bc93-488e-b73d-68113d94ce71 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.215059 Sep 11 10:56:38.965902 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 479/979] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:38 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:39.992426 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:39.993111 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:39.999156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:39.999666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:40.000096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:40.000769 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:40.001213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:40.002151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:40.132399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:40.140320 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:40.141733 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:40.143830 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ac411058-1d11-4de7-b4c9-07c727b5f2c3 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.156000 Sep 11 10:56:40.144547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 501/980] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:39 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:41.168974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:41.169508 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:41.176333 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:41.176825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:41.177268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:41.177971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:41.178430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:41.178858 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:41.312688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:41.321687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:41.323133 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:41.324324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9fa4412c-952e-4962-a4b7-859af9e3f315 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.159417 Sep 11 10:56:41.324883 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 480/981] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:41 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:42.350433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:42.351035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:42.357614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:42.358090 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:42.358515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:42.359189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:42.359920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:42.360337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:42.486844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:42.494739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:42.496186 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:42.497340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d5a13567-ffff-4126-8458-0ceec4f95a48 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.150753 Sep 11 10:56:42.497874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 502/982] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:42 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:43.522619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:43.523228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:43.529627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:43.530105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:43.530538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:43.531227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:43.531708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:43.532133 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:43.664569 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:43.672494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:43.674533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:43.675715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5fac68dd-711e-4328-bd17-f7b203b03580 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.157010 Sep 11 10:56:43.676262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 481/983] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:43 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:44.700744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:44.701396 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:44.707848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:44.708331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:44.708767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:44.709456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:44.709907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:44.710329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:44.841091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:44.849669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:44.851084 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:44.852247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c54f943c-fe03-4a4a-975f-eb334ed76a54 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1745 microversion: 2.20 time: 0.155345 Sep 11 10:56:44.852799 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 503/984] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:44 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:45.879738 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:45.880355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:45.893631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:45.894414 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:45.895149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:45.896180 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:45.896932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:45.897701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:46.062667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:46.071285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:46.072828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:46.074078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4d53f4f9-ca37-4514-adf0-755ce8849994 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.199462 Sep 11 10:56:46.074853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 482/985] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:45 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:47.102637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:47.103443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:47.111724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:47.112348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:47.112869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:47.113817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:47.114468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:47.115095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:47.456407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:47.465218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:47.467025 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:47.468385 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0d064743-3a88-4440-806c-7ec8da4a1ef1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.370833 Sep 11 10:56:47.469112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 504/986] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:47 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:48.065366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:48.066291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:48.072442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:48.072956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:48.073406 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:48.074391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:48.074864 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:48.075302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:48.195437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lazy-loading 'services' on Instance uuid 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:56:48.288684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b3f61339-ce60-4ed8-abf7-24af724bbe38 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15/os-volume_attachments/032ef2d4-7e1b-4ec6-a14e-df98ade1e274" status: 202 len: 0 microversion: 2.1 time: 0.228507 Sep 11 10:56:48.289921 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 483/987] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:56:48 2022] DELETE /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15/os-volume_attachments/032ef2d4-7e1b-4ec6-a14e-df98ade1e274 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:56:48.498749 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:48.499358 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:48.507647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:48.508428 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:48.509077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:48.510010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:48.510555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:48.511064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:48.654645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:48.663310 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:48.665045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:48.666196 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-eeacdcd0-ade4-46cb-809a-ef254c54ef03 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.171935 Sep 11 10:56:48.666779 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 505/988] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:48 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:49.694218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:49.695069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:49.703382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:49.704039 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:49.704626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:49.705284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:49.705742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:49.706177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:49.858606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:49.868549 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:49.870031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:49.871473 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-57971198-c814-4c93-88a4-836c8fdba717 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.181862 Sep 11 10:56:49.873107 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 484/989] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:49 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:50.504829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:50.505381 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:50.511558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.512046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.512483 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:50.513236 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.513687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.514316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:50.541684 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:56:50.625171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3a11163f-0166-4ba1-8487-9b5ec4feba5e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 204 len: 0 microversion: 2.1 time: 0.124317 Sep 11 10:56:50.628108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 506/990] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:56:50 2022] DELETE /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:56:50.636437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:50.637195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:50.643594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.644235 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.644746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:50.645596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.646129 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.646649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:50.802687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:50.810534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-70d4a633-183f-42ff-b426-3f984c137294 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1514 microversion: 2.1 time: 0.178013 Sep 11 10:56:50.811139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 485/991] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:50 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:50.900809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:50.901421 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:50.907388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.908477 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.908908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:50.909812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:50.910269 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:50.910694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:51.055645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:51.065838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:51.067390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:51.068995 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-466cb2a9-d8be-4706-9a13-f6d0130761c4 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.172565 Sep 11 10:56:51.083855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 507/992] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:50 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:51.835062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:51.835770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:51.842899 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:51.843409 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:51.843987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:51.844739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:51.846065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:51.846405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:52.094671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:52.096213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:52.103962 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:52.104459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:52.105027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:52.106019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:52.106366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:52.106796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:52.338618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:52.347890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-af838433-682a-4d46-ac92-031d2f1e8d82 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1514 microversion: 2.1 time: 0.516634 Sep 11 10:56:52.348722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 486/993] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:51 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1514 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:52.381217 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:52.390092 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:52.391576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:52.393728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ec348b7-6804-411c-b06e-4b4c31f8f188 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.302994 Sep 11 10:56:52.394647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 508/994] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:52 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:56:53.372711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:53.373993 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:53.390875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:53.391674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:53.393016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:53.394050 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:53.394524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:53.394956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:53.420588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:53.421171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:53.428013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:53.431941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:53.432980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:53.433899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:53.434920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:53.435549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:53.546495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:53.557192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a7ee4ddf-6c1e-4edb-8045-dc3cfe95f80d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 200 len: 1472 microversion: 2.1 time: 0.187143 Sep 11 10:56:53.558338 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 487/995] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:53 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:56:53.564580 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9b043b-ed7b-4314-80a7-e26ef3d01f15", "name": "network-vif-deleted", "tag": "b1a0ef4d-8c84-4cf7-8752-8178ece35043"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:56:53.576331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:53.577095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:53.577712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:53.592814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] Creating event network-vif-deleted:b1a0ef4d-8c84-4cf7-8752-8178ece35043 for instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 on hv-cinder-85646 Sep 11 10:56:53.608045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-99d11597-aea5-4bf4-a46b-b426f54b5639 req-169708d9-65e9-47e0-8977-62a326e41ea1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048141 Sep 11 10:56:53.609141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 488/996] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:56:53.672107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:53.684377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:53.686522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:53.687900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-23eca8c7-de04-419d-9d7c-9d3dfd35ac08 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.271194 Sep 11 10:56:53.689005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 509/997] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:53 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:54.585022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:54.586655 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 7c9b043b-ed7b-4314-80a7-e26ef3d01f15] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:54.594134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:54.594935 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:54.595590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:54.596634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:54.597257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:54.597853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:54.617123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] HTTP exception thrown: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Request method failure captured: Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 HTTP/1.1 Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb6n5f3F85quoluYOcp0MvhwrSUIy93V3rQH05gI6t9D4oEIRXlAFgLm1vwkzffzurND9DpOuyp72Q1oIzTCCmU0_e3OXkvH49Pgznvb_Kh9dHvQWB-9fNBoRjbrcGY4CALo0Jdgp19ydIZ7KM5Dr734W8kpXpxk12W4atVQVqZNS6U Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 80459f77fe204aefb516e8389f1458fc Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:56:54.618812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80459f77fe204aefb516e8389f1458fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80459f77fe204aefb516e8389f1458fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80459f77fe204aefb516e8389f1458fc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80459f77fe204aefb516e8389f1458fc"}]}] Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 80459f77fe204aefb516e8389f1458fc Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesSnapshotTestJSON-1728568692-project Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: fc2f971c8c4d47f59c79495289e59112 Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesSnapshotTestJSON-1728568692-project Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. Sep 11 10:56:54.620531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '7c9b043b-ed7b-4314-80a7-e26ef3d01f15'} Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:56:54.621402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. Sep 11 10:56:54.628618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:56:54.629841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Returning 404 to user: Instance 7c9b043b-ed7b-4314-80a7-e26ef3d01f15 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:56:54.629841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6088157b-f92a-4104-b3f3-c20cbccc01c7 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15" status: 404 len: 111 microversion: 2.1 time: 0.040352 Sep 11 10:56:54.629841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 489/998] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:56:54 2022] GET /compute/v2.1/servers/7c9b043b-ed7b-4314-80a7-e26ef3d01f15 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:56:54.715766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:54.716981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:54.728097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:54.729173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:54.729572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:54.730345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:54.730798 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:54.731489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:54.911757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:54.921252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:54.922724 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:54.924068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-35a8490c-83b6-425d-98e3-926b4181325a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.213266 Sep 11 10:56:54.924662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 510/999] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:54 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:55.950223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:55.950856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:55.958303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:55.958792 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:55.959227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:55.959962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:55.960415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:55.960840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:56.101249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:56.109696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:56.111337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:56.112534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7319e075-b5d8-4bea-81a3-9615cc54d3a5 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.166231 Sep 11 10:56:56.113082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 490/1000] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:55 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:57.136704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:57.137287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:57.143829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:57.144301 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:57.144728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:57.145412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:57.145858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:57.146274 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:57.273166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:57.281173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:57.282588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:57.284458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3b4e9f0e-67c1-4b05-8d34-b539a395efed tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.150918 Sep 11 10:56:57.285116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 511/1001] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:57 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:58.310274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:58.310879 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:58.318126 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:58.318629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:58.319063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:58.319776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:58.320350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:58.320770 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:58.449595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:58.458051 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:58.459488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:58.460636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-357e761d-7679-40af-b698-ae31b524a942 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.154458 Sep 11 10:56:58.461184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 491/1002] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:58 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:56:59.486151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:56:59.487247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:56:59.493858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:59.494341 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:59.494768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:59.495468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:56:59.495914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:56:59.496331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:56:59.628013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:59.638079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:59.639522 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:56:59.640680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7caf1b37-6de9-4f93-b969-fbced59138e6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.158823 Sep 11 10:56:59.641224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 512/1003] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:56:59 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:00.666085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:00.666706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:00.673244 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:00.673732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:00.674725 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:00.675418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:00.675898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:00.676423 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:00.807185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:00.815228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:00.816907 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:00.818433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a8a441d3-6d05-41ff-bb86-c41c629243cd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.156146 Sep 11 10:57:00.819037 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 492/1004] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:00 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:01.843824 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:01.844430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:01.850806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:01.851286 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:01.852102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:01.852806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:01.853253 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:01.853715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:01.981978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:01.984333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:01.992421 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:01.993849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:01.995009 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e1a061af-8aa6-4457-99d8-4ff8ab150369 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.155217 Sep 11 10:57:01.995588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 513/1005] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:01 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:03.020681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:03.021287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:03.027736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:03.028226 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:03.028682 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:03.029360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:03.029817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:03.030248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:03.160340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:03.168687 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:03.170103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:03.171278 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ecd3ba71-f077-4618-85b7-b52dbb080c13 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1740 microversion: 2.20 time: 0.155155 Sep 11 10:57:03.173382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 493/1006] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:03 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:03.745685 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "name": "network-vif-unplugged", "status": "completed", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:03.757812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:03.758287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:03.758817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:03.770854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] Creating event network-vif-unplugged:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:57:03.776219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-e19e2c12-4f2e-4089-b17d-f9de06952d32 req-4c1eb604-5b0e-4ec2-8e5e-14cf4863a01f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034244 Sep 11 10:57:03.776891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 514/1007] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:04.196538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:04.197147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:04.199395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 10:57:04.199560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sun Sep 11 10:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 (ip 10.222.0.15) !!! Sep 11 10:57:04.206802 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:04.207193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:04.207681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:04.208400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:04.208859 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:04.209286 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:04.388262 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:04.399021 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:04.400766 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:04.401964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f7845f03-49de-41bc-a6ad-4b0bc9f945a1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.209282 Sep 11 10:57:04.402525 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 494/1008] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:04 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:05.432729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:05.433458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:05.435664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:05.441854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:05.442349 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:05.442772 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:05.443704 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:05.444331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:05.444754 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:05.608608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:05.618756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:05.620324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:05.621561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c61e1ca5-2d6a-4def-b070-1ecdd6298389 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.194071 Sep 11 10:57:05.622524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 515/1009] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:05 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:06.647449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:06.648056 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:06.650384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=34 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:06.655903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:06.656400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:06.656972 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:06.657546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:06.658008 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:06.658489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:06.663034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:06.793413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:06.802087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:06.803591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:06.804763 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2d91d515-cef3-4c44-9290-279a25445736 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.161269 Sep 11 10:57:06.805318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 495/1010] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:06 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:07.829867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:07.831127 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:07.837621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:07.838109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:07.838548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:07.839239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:07.839722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:07.840151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:07.969562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:07.977673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:07.979099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:07.980302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-36fc90e4-ecc7-46aa-a73c-7185152f081e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.154356 Sep 11 10:57:07.980853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 516/1011] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:07 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:09.006573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:09.007190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:09.013454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:09.014033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:09.014472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:09.015186 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:09.015722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:09.016149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:09.147071 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:09.155048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:09.156517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:09.157673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d6db3856-fc7d-4cd5-a636-301e6952c67a tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.155714 Sep 11 10:57:09.158228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 496/1012] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:09 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:10.182714 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:10.183507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:10.190026 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:10.190513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:10.190959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:10.191690 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:10.192149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:10.192574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:10.319185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:10.327454 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:10.328887 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:10.330049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-dd9081f3-3937-4010-be63-545811a77306 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1722 microversion: 2.20 time: 0.151835 Sep 11 10:57:10.331107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 517/1013] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:10 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:11.356663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:11.357269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:11.364579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.365064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.365504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:11.366195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.366648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.367074 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:11.496723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:11.505240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:11.506737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:11.507956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-68a90271-cba6-473c-b5ac-4c54094d00cb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1665 microversion: 2.20 time: 0.155269 Sep 11 10:57:11.508501 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 497/1014] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:11 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:11.532391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6a0d72-b178-4448-a5af-695ccd69aeaa"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:11.534792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:11.541078 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.541552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.541978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:11.542658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.543105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.543547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:11.810959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3b6b71be-c246-4df7-8e02-a52574bf6ac2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282374 Sep 11 10:57:11.811710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 518/1015] 10.222.0.15 () {62 vars in 1364 bytes} [Sun Sep 11 10:57:11 2022] POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 10:57:11.845598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1086932790", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "networks": [{"uuid": "f5bd004a-0b1d-4f2b-93a8-0e6a1eed2718"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:11.902791 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] validate_networks() for [('f5bd004a-0b1d-4f2b-93a8-0e6a1eed2718', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:57:11.941523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:11.942024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:11.947978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.948465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.948903 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:11.954085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:11.954085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:11.954085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.191680 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-83f9b22c-f05d-464a-ae75-e4dd30b07f9c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments/4e6a0d72-b178-4448-a5af-695ccd69aeaa" status: 202 len: 0 microversion: 2.20 time: 0.254415 Sep 11 10:57:12.192473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 519/1016] 10.222.0.15 () {60 vars in 1457 bytes} [Sun Sep 11 10:57:11 2022] DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments/4e6a0d72-b178-4448-a5af-695ccd69aeaa => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:57:12.254800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:12.255394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:12.261678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.262169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.262634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.263355 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.263837 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.264262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.298679 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137535) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 10:57:12.318793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:57:12.319265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:57:12.319768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:57:12.320203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:57:12.320608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:57:12.329279 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.329688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.330121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.330839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.331963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.332575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.349964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Getting quotas for project 80459f77fe204aefb516e8389f1458fc. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:57:12.353943 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Getting quotas for user fc2f971c8c4d47f59c79495289e59112 and project 80459f77fe204aefb516e8389f1458fc. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:57:12.366350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:57:12.367299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-834c3350-cb32-40a2-be0b-2e364efbe1c9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/action" status: 202 len: 0 microversion: 2.20 time: 0.116444 Sep 11 10:57:12.367946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 520/1017] 10.222.0.15 () {62 vars in 1319 bytes} [Sun Sep 11 10:57:12 2022] POST /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 10:57:12.368684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:57:12.376012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:12.376383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:12.382998 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.385062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.385062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.385062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:12.385062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:12.385555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:12.419656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-231b2750-9a7a-418b-bea4-4449df1679f2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578062 Sep 11 10:57:12.420585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 498/1018] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:57:12.433023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b2d641e9-14eb-4fdf-adbb-8ffa6ff3f5d8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:12.433814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b2d641e9-14eb-4fdf-adbb-8ffa6ff3f5d8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:12.494083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b2d641e9-14eb-4fdf-adbb-8ffa6ff3f5d8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:12.502005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b2d641e9-14eb-4fdf-adbb-8ffa6ff3f5d8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1219 microversion: 2.1 time: 0.073683 Sep 11 10:57:12.503713 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 499/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:12 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:12.563360 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:12.572494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:12.573927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:12.576867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ec2fa3d-fc68-41de-ab05-d14b9a5ee089 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1673 microversion: 2.20 time: 0.204640 Sep 11 10:57:12.577523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 521/1020] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:12 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:13.525642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:13.526256 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:13.532685 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:13.533161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:13.533590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:13.534420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:13.534877 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:13.535299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:13.598551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:13.602489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:13.603118 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:13.606105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-589c91d2-456e-4cc1-a481-b795ee09d320 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1271 microversion: 2.1 time: 0.084316 Sep 11 10:57:13.606698 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 500/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:13 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:13.609778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:13.610257 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:13.610689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:13.611377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:13.611854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:13.612869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:13.837797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:13.850318 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:13.852664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:13.853874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a490e381-2b78-426e-9312-1a106608453f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1675 microversion: 2.20 time: 0.255303 Sep 11 10:57:13.854546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 522/1022] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:13 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:14.631100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:14.631736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:14.638130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:14.638614 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:14.639599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:14.639779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:14.640234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:14.640656 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:14.882201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:14.882812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:14.889874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:14.890614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:14.891114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:14.891851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:14.892308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:14.892738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:15.021102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:15.028813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-60afeb51-4cca-450d-b2ce-777ab3b341a2 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.402755 Sep 11 10:57:15.029463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 501/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:14 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:15.245720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66495336", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-13039510", "security_groups": [{"name": "tempest-secgroup-smoke-1317451716"}], "block_device_mapping_v2": [{"uuid": "26989c29-5b42-45ca-98b0-c5b37be4c18f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2be92be9-cd67-4fcc-bf1b-6ceeb89de07d"}]}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:15.493031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:15.495236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] validate_networks() for [('2be92be9-cd67-4fcc-bf1b-6ceeb89de07d', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:57:15.501396 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:15.503364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:15.504563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8aabfbe6-4f2c-4df5-b24b-0f6d58861b42 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.626884 Sep 11 10:57:15.505115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 523/1024] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:14 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:16.053866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:16.054660 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:16.062034 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.062621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.063464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.064345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.064885 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.066137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.347971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:57:16.348548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:57:16.349401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:57:16.350397 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:57:16.351524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:57:16.352907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:16.358503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:16.361651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.363703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.364509 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.365334 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e982255b-1eee-4873-9216-ba8ace86f93d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.316720 Sep 11 10:57:16.365475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.365882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.366469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.367449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 524/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:16 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:16.402965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb42415-5790-4318-a27b-ca33dd9fa30c", "tag": "64525ddf-ed37-46fa-a1c0-dcaca7e2c88c"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:16.408642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:57:16.413912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Getting quotas for user e1b0815853b947bc8f50d91c1ce0ab5a and project 23556239691f46aa8b39bb6219fc591f. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:57:16.415347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.416133 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.416551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.435097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] Creating event network-changed:64525ddf-ed37-46fa-a1c0-dcaca7e2c88c for instance 0fb42415-5790-4318-a27b-ca33dd9fa30c on hv-cinder-85646 Sep 11 10:57:16.442592 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-40ace953-ae2a-49ca-b6b2-afa7f6f44f6c req-639ac829-69ec-47bf-acbd-ddbf5b93a8f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063228 Sep 11 10:57:16.443882 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 525/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:16.531338 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:57:16.533474 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26989c29-5b42-45ca-98b0-c5b37be4c18f',volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:57:16.540163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:16.541729 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:16.556489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.557207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.557867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.560636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:16.561249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:16.561846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:16.786082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:16.797479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:16.797690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-023bb8bd-5cb2-4c70-bbff-bce69b9dde7e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.555826 Sep 11 10:57:16.798982 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:16.800574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7fba6dbd-a676-4fa6-9d75-f06284c41ba9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.273996 Sep 11 10:57:16.801258 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 526/1027] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:16 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:16.801716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 502/1028] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:57:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 10:57:16.818528 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b12fea43-afd8-40c8-a1c9-ebe9bf476966 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:16.819628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b12fea43-afd8-40c8-a1c9-ebe9bf476966 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:16.890353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b12fea43-afd8-40c8-a1c9-ebe9bf476966 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:16.906205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b12fea43-afd8-40c8-a1c9-ebe9bf476966 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1091 microversion: 2.1 time: 0.093427 Sep 11 10:57:16.909786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 527/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:16 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1091 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:17.393890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:17.394724 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:17.401464 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.401961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.402624 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.403344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.403833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.404269 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.538291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:17.546102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a91dc730-fb5a-4881-bcfd-b8217df11304 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.160038 Sep 11 10:57:17.546659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 503/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:17 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:17.829089 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:17.829677 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:17.837230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.837715 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.838151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.838841 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.839292 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.839751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.931024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:17.931677 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:17.937950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.938433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.938865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.939593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:17.940048 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:17.940979 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:17.995486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:18.004122 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:18.005555 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:18.006725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-769138b4-84b8-4552-8534-045df4fb2177 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.181578 Sep 11 10:57:18.007287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 528/1031] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:17 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:18.010930 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:18.019171 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-80f3132d-4979-42a3-acd0-c09a6dd991e9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.091486 Sep 11 10:57:18.019774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 504/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:17 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:18.570308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:18.570849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:18.576742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:18.577220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:18.577654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:18.578339 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:18.578811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:18.579326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:18.736338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:18.745630 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-401b170a-1360-42db-9e82-f8f70229fb7b tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.179739 Sep 11 10:57:18.746479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 529/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:18 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:19.032111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:19.032717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:19.039170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.039697 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.040137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.040837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.041356 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.041663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:19.042083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.042273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:19.049000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.049492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.050568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.051222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.051697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.052114 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.145997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:19.153649 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a5260df7-4d31-47df-914d-ae1b09ce9ee7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.115886 Sep 11 10:57:19.173631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 530/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:19 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:19.213323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:19.225025 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:19.227579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:19.229641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cb498216-fd8d-4655-b4b5-9d6de1bcaafd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.201379 Sep 11 10:57:19.231082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 505/1035] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:19 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:19.771324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:19.771956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:19.777858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.778332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.778763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.779468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:19.779924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:19.780348 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:19.918405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:19.927927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8c3d2094-7abb-4829-a40f-4c1dfd93d88d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.160922 Sep 11 10:57:19.928839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 531/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:19 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:20.181748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:20.182548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:20.195083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.195629 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.196169 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:20.196947 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.197441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.197870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:20.256871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:20.257490 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:20.260868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:20.263950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.264433 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.264861 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:20.265543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.265991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.266407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:20.269151 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8aa3a83d-c31b-4bdc-bf83-a21ea5f31bd3 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.091064 Sep 11 10:57:20.269744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 506/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:20 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:20.405190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:20.414605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:20.416155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:20.417482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1ff5f957-c223-4b88-a9f7-45c535338f86 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.164842 Sep 11 10:57:20.418568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 532/1038] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:20 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:20.951534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:20.952731 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:20.960165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.960747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.961263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:20.962105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:20.962796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:20.963336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:21.095001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:21.102913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3ceeea83-6217-433f-9a9b-0bdbffd562c1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.156218 Sep 11 10:57:21.103494 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 507/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:20 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:21.293174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:21.294550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:21.302224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:21.302807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:21.303509 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:21.304297 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:21.304763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:21.305191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:21.372908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:21.381531 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-adadae55-9bdf-4766-a0c1-c4c0cca9cccb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.092699 Sep 11 10:57:21.382299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 533/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:21 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:21.442164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:21.442804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:21.449267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:21.449756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:21.450195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:21.450889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:21.451349 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:21.451822 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:21.587036 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:21.595239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:21.597313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:21.598836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-31682b24-2c29-4436-ab63-4130078a6c6f tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.160640 Sep 11 10:57:21.599399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 508/1041] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:21 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:22.126180 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:22.126829 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:22.133725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.134169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.134584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.135272 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.135755 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.136181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.266170 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:22.274575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ab31d35e-472c-46e2-8097-eb5cb47849a8 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.152219 Sep 11 10:57:22.275345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 534/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:22 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:22.404277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:22.404807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:22.411388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.412123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.412633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.413511 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.413988 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.414419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.485773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:22.497468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-80dfb6aa-a10d-4f95-93d9-980420c177ee tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.096871 Sep 11 10:57:22.502386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 509/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:22 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:22.626041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:22.626989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:22.635803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.636494 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.636928 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.637657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:22.638102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:22.638567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:22.781460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:22.790194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:22.791648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:22.792816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3278bf64-d655-475f-af16-6a031ff94cfc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.171874 Sep 11 10:57:22.793369 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 535/1044] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:22 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:23.298163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:23.298779 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:23.305387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.305912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.306357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.307053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.307546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.307977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.448308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:23.457486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-69faf9f8-b45a-471c-aaa5-e1aca0d3e862 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.163119 Sep 11 10:57:23.458272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 510/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:23 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:23.521792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:23.522404 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:23.528719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.529336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.529780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.530909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.531373 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.531843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.596474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:23.604781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-872f308c-2172-4845-b0fe-0c01a3f4292a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.087244 Sep 11 10:57:23.605526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 536/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:23 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:23.818046 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:23.818678 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:23.825324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.825876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.826313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.827088 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:23.827788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:23.828216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:23.979861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:23.988929 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:23.990420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:23.991562 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-15ca7f80-bc2f-48a5-915e-069e85f96c57 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.177990 Sep 11 10:57:23.992128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 511/1047] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:23 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:24.479730 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:24.480347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:24.487062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:24.487608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:24.488046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:24.488735 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:24.489194 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:24.489620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:24.620524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:24.629099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-10532276-326c-4b13-90bb-048f1995f7f4 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.153379 Sep 11 10:57:24.629318 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:24.629663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 537/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:24 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:24.629944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:24.636602 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:24.637094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:24.637537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:24.638242 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:24.638701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:24.639130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:24.705707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:24.713911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-01fb81c4-2826-425d-b260-7734378eb665 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.089213 Sep 11 10:57:24.714469 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 512/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:24 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:25.016740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:25.017366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:25.023365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.023871 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.024582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.025740 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.026307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.026883 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.163398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:25.172225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:25.173658 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:25.174817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-50ef328d-01ee-4464-b8b9-a367dd11ad51 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.162245 Sep 11 10:57:25.176035 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 538/1050] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:25 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:25.651955 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:25.652521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:25.658755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.659231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.659748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.660951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.661401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.661824 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.737026 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:25.737630 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:25.744349 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.744827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.745261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.745958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:25.746411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:25.746836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:25.816239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:25.826927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-53c1eec1-09bd-4bde-8045-246b500e37f3 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.178688 Sep 11 10:57:25.827748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 513/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:25 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:25.837838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:25.846137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5c4c4e5d-6618-4de5-8697-9503295d9b4a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.113206 Sep 11 10:57:25.846908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 539/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:25 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:26.200744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:26.201354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:26.207480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.207974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.208411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.209115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.209574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.209997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.212775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:26.369081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:26.377345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:26.378856 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:26.380045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7a1ee5ce-ecf0-435e-871d-503a7d910388 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.183245 Sep 11 10:57:26.380751 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 514/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:26 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:26.852378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:26.853003 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:26.859367 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.860155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.860587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.861270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.861720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.862142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.870145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:26.870758 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:26.872582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=4 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:26.873287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=14 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:26.880190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.880934 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.881429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.882164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:26.882630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:26.883117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:26.924267 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:27.007298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:27.015901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1d5c6ccd-779f-4684-ac2e-4817f2ec3558 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.149441 Sep 11 10:57:27.020153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 515/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:26 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:27.105475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:27.123712 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bce9268b-6caa-4dc4-91cf-a5721eecceab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.275045 Sep 11 10:57:27.124800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 540/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:26 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:27.405386 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:27.405903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:27.412871 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:27.413360 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:27.413790 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:27.414488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:27.414940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:27.415455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:27.553314 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:27.562616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:27.564079 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:27.565252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-90bd0548-67f4-4abd-98ca-d6add38aaccd tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.163881 Sep 11 10:57:27.565800 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 516/1056] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:27 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:28.039478 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:28.040105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:28.046466 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.046946 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.047374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.048087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.048536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.048953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.123937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:28.132453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-02229a68-de0f-45e2-8c7d-40eb53d5d643 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.097476 Sep 11 10:57:28.133038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 541/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:28 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:28.148703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:28.149330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:28.155746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.156229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.156659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.157345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.157793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.158206 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.288435 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:28.296070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e568b436-e36f-4175-ac4c-dd6b91ff750e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.152341 Sep 11 10:57:28.296567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 517/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:28 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:28.589879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:28.590411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:28.596333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.596827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.597408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.598106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:28.598558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:28.598985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:28.732560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:28.741393 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:28.742800 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:28.743972 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3fbd59bc-9deb-4963-8db1-cea41bb5251d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.158102 Sep 11 10:57:28.744523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 542/1059] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:28 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:29.156166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:29.156771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:29.163713 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.164196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.164628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.165312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.165788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.166207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.225928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:29.233486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dd4535bb-f197-417c-9239-e79c218a2915 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.081269 Sep 11 10:57:29.234033 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 518/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:29 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:29.318028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:29.318644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:29.325152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.325636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.326073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.326761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.327209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.327663 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.332087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:29.459683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:29.467212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-67981d2d-b245-486d-b20a-96a1aa8f460a tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.153172 Sep 11 10:57:29.467812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 543/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:29 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:29.769884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:29.770700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:29.776548 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.777029 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.777498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.778217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:29.778667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:29.779085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:29.913760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:29.921737 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:29.923142 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:29.924312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e8a8cb57-4bd2-418d-b076-a4930ecb17c2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.159101 Sep 11 10:57:29.924870 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 519/1062] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:29 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:30.258161 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:30.258806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:30.264876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.265359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.265797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:30.266486 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.266942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.267386 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:30.330867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:30.339008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-64437100-bc9f-48c3-83e0-f2ceaaac7194 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.086011 Sep 11 10:57:30.339597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 544/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:30 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:30.491211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:30.491837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:30.498156 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.498636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.499066 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:30.499786 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.500236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.500659 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:30.632024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:30.639552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8de0fa2d-22a2-466a-b655-8c8c12b73a6f tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.152897 Sep 11 10:57:30.640109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 520/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:30 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:30.949569 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:30.950167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:30.956033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.957434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.957868 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:30.958557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:30.959010 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:30.959450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:31.086816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:31.094987 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:31.096446 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:31.098384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a9888bc7-baa3-4551-900a-982d47a76113 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.152510 Sep 11 10:57:31.098948 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 545/1065] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:30 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:31.362712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:31.363331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:31.369272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:31.369762 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:31.370205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:31.370923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:31.371390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:31.371843 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:31.434642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:31.442834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cb959f78-8002-43f6-8b1d-e0ca2f626e1f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.084276 Sep 11 10:57:31.443442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 521/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:31 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:31.664027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:31.664553 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:31.671100 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:31.671616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:31.672045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:31.672726 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:31.673199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:31.673612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:31.807070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:31.814767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3b6b1a87-9440-458d-9dd7-989436d9e68e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.154763 Sep 11 10:57:31.815326 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 546/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:31 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:32.124014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:32.124631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:32.131692 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.132184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.132628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.133353 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.133815 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.134243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.261633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:32.269576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:32.271009 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:32.272203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-35113f0a-da08-41d1-9b4a-8be612dc81ff tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.152092 Sep 11 10:57:32.272747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 522/1068] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:32 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:32.466476 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:32.467017 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:32.473285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.473759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.474195 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.474914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.475371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.475840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.535245 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:32.542845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f8b4a55f-7355-442c-84b1-002f8631443f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.080323 Sep 11 10:57:32.543402 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 547/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:32 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:32.839733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:32.840346 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:32.846345 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.846826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.847809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.848524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:32.848985 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:32.849408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:32.977927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:32.985735 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a53be804-9944-4912-9cea-c11eaa3d617e tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.149924 Sep 11 10:57:32.986299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 523/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:32 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:33.297291 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:33.297900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:33.304588 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:33.305066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:33.305501 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:33.306218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:33.306689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:33.307094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:33.435790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:33.444471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:33.445904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:33.447096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b1da9bba-a8b7-4b26-a118-e0fb356e1e4d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.153722 Sep 11 10:57:33.447687 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 548/1071] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:33 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:33.566759 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:33.567307 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:33.573795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:33.574280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:33.574721 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:33.575413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:33.575892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:33.576317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:33.637720 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:33.645853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ff00d063-cc3c-4082-a409-233f49cb2501 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1141 microversion: 2.1 time: 0.083728 Sep 11 10:57:33.646408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 524/1072] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:33 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1141 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:34.008792 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:34.009495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:34.015683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.016748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.017287 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.018051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.018374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.019340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.151623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:34.159097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-659d948e-6b65-4bbe-a1ed-a0f0ef89b8ab tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.154212 Sep 11 10:57:34.159695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 549/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:34 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:34.472756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:34.473289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:34.479317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.479835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.480282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.480968 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.481426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.481853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.614108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:34.622108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:34.623581 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:34.624742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fe7a0b43-d59a-4005-a22b-be5e276da262 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.156061 Sep 11 10:57:34.625299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 525/1074] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:34 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:34.668106 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:34.668716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:34.675668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.676351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.676789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.677483 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:34.677939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:34.678362 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:34.741028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:34.748626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-68e45209-0d40-4bfa-aa4f-88213c9c1a62 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1189 microversion: 2.1 time: 0.084356 Sep 11 10:57:34.749285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 550/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:34 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1189 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:35.182196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:35.182814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:35.188795 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.189284 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.189725 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.190420 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.190927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.191362 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.317897 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:35.325449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-398eb8cd-38ca-4f0c-83e3-c4d1127b8d48 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.147182 Sep 11 10:57:35.326016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 526/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:35 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:35.650653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:35.651249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:35.653108 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:35.658333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.658809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.659238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.660389 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.660853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.661270 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.773571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:35.774380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:35.780983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.781478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.781920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.782625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:35.783293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:35.783753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:35.793813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:35.802727 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:35.804183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:35.805364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-51862c9b-007f-4963-b75f-33da2a0b34b1 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.158602 Sep 11 10:57:35.805914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 551/1077] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:35 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:35.847400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:35.855225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b147c551-6c0d-4885-a532-5b2ffa81f82f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1189 microversion: 2.1 time: 0.086965 Sep 11 10:57:35.855821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 527/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:35 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1189 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:36.349938 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:36.350546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:36.357112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.357599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.358036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:36.358732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.359183 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.359913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:36.560460 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:36.568236 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-13fc5cac-e735-4fc2-aec6-72310988b406 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.222847 Sep 11 10:57:36.568943 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 552/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:36 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:36.830564 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:36.832004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:36.834767 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:36.840845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.841772 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.842257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:36.842924 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.843378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.843852 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:36.878166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:36.879107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:36.886157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.886757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.887271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:36.888269 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:36.889058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:36.889560 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:37.169741 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:37.177495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8a0dff78-6fc4-4ac0-b309-1bd82ea8cf86 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1197 microversion: 2.1 time: 0.303228 Sep 11 10:57:37.178058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 553/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:36 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:37.394832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:37.403154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:37.404745 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:37.405914 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f59d99af-56d7-4f81-9a1a-f384a6be528d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.579636 Sep 11 10:57:37.406471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 528/1081] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:36 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:37.590230 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:37.590862 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:37.596809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:37.597340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:37.597931 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:37.598633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:37.599096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:37.599525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:37.805157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:37.813063 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3761b23d-84c8-4073-bcd9-a3c04e7f8a69 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.226635 Sep 11 10:57:37.813645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 554/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:37 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:38.201459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "name": "network-vif-plugged", "status": "completed", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:38.204243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:38.205930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:38.216627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.217527 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.218610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.219791 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.220596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.221398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.222327 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.224028 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.224484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.258257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] Creating event network-vif-plugged:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:57:38.267130 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-507cdb23-1095-4daa-8c68-d64b6cebb720 req-a6ce0368-1095-47fd-b141-fe568d7904e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069574 Sep 11 10:57:38.267784 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 529/1083] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:38.432495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:38.433204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:38.439521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.440012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.440495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.442263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.442730 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.443164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.456790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:38.467867 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9ce06de7-e92f-42aa-a9d0-6eb2b947d830 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.268405 Sep 11 10:57:38.468525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 555/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:38 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:38.773689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:38.782426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:38.783901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:38.785704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c68f9648-c87a-4de1-86ea-8b4a7940fbf2 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.358033 Sep 11 10:57:38.786401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 530/1085] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:38 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 10:57:38.837692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:38.838309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:38.844768 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.845259 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.845694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:38.846395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:38.848299 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:38.848898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.078931 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:39.087378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96c4caef-da23-48d5-9e46-e12077321902 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.253679 Sep 11 10:57:39.087973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 556/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:38 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:39.299017 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3129ff09-bea4-47cf-9957-d5baa397d723", "tag": "65134e44-75ce-4fd2-b29f-ef8136f5ab4d"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:39.308532 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:39.309019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:39.309454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.320648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] Creating event network-changed:65134e44-75ce-4fd2-b29f-ef8136f5ab4d for instance 3129ff09-bea4-47cf-9957-d5baa397d723 on hv-cinder-85646 Sep 11 10:57:39.325350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-88c974fd-7d28-4d13-ab0a-97307752b356 req-de82c89e-8de2-4c1e-9509-75389368829a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092813 Sep 11 10:57:39.325923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 531/1087] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:39.492022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:39.492557 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:39.498862 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:39.499336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:39.499803 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.500480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:39.500924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:39.501338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.636964 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:39.645207 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-84c61972-7e26-4514-bb80-1e3cd84add8e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.157571 Sep 11 10:57:39.645767 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 557/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:39 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:39.813192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:39.813891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:39.820977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:39.821585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:39.822067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.822957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:39.823447 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:39.823884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:39.826512 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=100 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:40.022364 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:40.031982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:40.033426 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:40.035277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3146e616-3a7c-42a2-b766-329ab6a176c6 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.226407 Sep 11 10:57:40.047625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 532/1089] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:39 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:40.110708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:40.111314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:40.117443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:40.117917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:40.118347 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:40.119040 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:40.119514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:40.119937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:40.288246 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb42415-5790-4318-a27b-ca33dd9fa30c", "name": "network-vif-plugged", "status": "completed", "tag": "64525ddf-ed37-46fa-a1c0-dcaca7e2c88c"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:40.297752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:40.298231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:40.298663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:40.309765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] Creating event network-vif-plugged:64525ddf-ed37-46fa-a1c0-dcaca7e2c88c for instance 0fb42415-5790-4318-a27b-ca33dd9fa30c on hv-cinder-85646 Sep 11 10:57:40.314639 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-5000131f-9ecd-4ee4-b4ac-c3198a9b96f6 req-77b80653-508e-443c-9311-d6de188c72ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Sep 11 10:57:40.315305 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 533/1090] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:40.317503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:40.325146 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-60fef11a-1952-4098-a9d1-c8c872f886db tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.218426 Sep 11 10:57:40.325644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 558/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:40 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:40.670017 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:40.670631 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:40.676939 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:40.677427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:40.677861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:40.678558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:40.679015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:40.679465 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:40.811164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:40.818941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-57c2d71f-564e-4dd0-a3be-f99d71e43edb tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.153318 Sep 11 10:57:40.819837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 534/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:40 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:41.061847 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:41.062778 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:41.070407 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.071061 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.071581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.072352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.072878 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.073371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.217456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:41.220886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=100 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:41.226945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:41.228431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:41.229605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-28511734-2538-4a42-a99d-3b4824dfc7ca tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1731 microversion: 2.20 time: 0.172210 Sep 11 10:57:41.230166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 559/1093] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:41 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:41.348965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:41.349582 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:41.356236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.356740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.357176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.358015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.358462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.358888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.490415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:41.498072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f7d1120c-b7af-43b6-9eab-31bb98ab02cf tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.153412 Sep 11 10:57:41.498628 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 535/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:41 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:41.843834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:41.844435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:41.851058 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.851570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.852002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.852707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:41.853154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:41.853572 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:41.989241 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:41.997020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f97d64ff-beae-4efe-95f7-db49c71ff25b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.157073 Sep 11 10:57:41.997587 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 560/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:41 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:42.259894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:42.260498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:42.266439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:42.266916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:42.267348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:42.268058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:42.268530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:42.269238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:42.395684 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:42.403821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:42.405264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:42.406448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9b29e7be-6d0d-4f3a-9674-7e9550685b2c tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1718 microversion: 2.20 time: 0.150444 Sep 11 10:57:42.406994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 536/1096] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:57:42 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:57:42.522637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:42.523247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:42.529698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:42.530176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:42.530610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:42.531296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:42.531777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:42.532203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:42.733116 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:42.741752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-554c4e88-5c26-4e23-8ed9-9be8a02bc3a1 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1319 microversion: 2.1 time: 0.223302 Sep 11 10:57:42.742314 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 561/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:42 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:43.023165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:43.023806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:43.029680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.030160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.030592 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:43.031277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.031753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.032174 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:43.160780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:43.168448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-11cbd7b5-0a11-4f13-9dd0-55f0a1e6c02b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.149752 Sep 11 10:57:43.169015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 537/1098] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:43 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:43.763457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:43.764008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:43.770814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.771316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.771774 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:43.772451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.772899 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.773316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:43.904435 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:43.912833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d43eb444-430c-4142-9458-26743ebfc271 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1508 microversion: 2.1 time: 0.153399 Sep 11 10:57:43.913400 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 562/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:43 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:43.935521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ef3a055-a4a2-4ee1-b716-a6927ff48c7e", "device": "/dev/sdb"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:43.938489 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:43.945105 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.945590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.946026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:43.946723 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:43.947179 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:43.947638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:44.190414 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:44.191046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:44.196983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:44.197465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:44.197896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:44.198581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:44.199038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:44.199480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:44.336843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:44.344576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-68e7fde0-c673-4e22-a11c-c1e682c2d0c7 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.158125 Sep 11 10:57:44.345149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 563/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:44 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:44.421984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b9b487e3-c42d-475f-a8b6-cf46e9d1d130 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "POST /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490267 Sep 11 10:57:44.422595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 538/1101] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:57:43 2022] POST /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:45.368924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:45.369479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:45.375637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:45.376076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:45.376507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:45.377189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:45.377639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:45.378392 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:45.512051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:45.520091 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-34f8e134-2223-456e-85c3-be1d06ee625f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.155159 Sep 11 10:57:45.520661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 564/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:45 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:46.546804 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:46.547608 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:46.554372 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:46.554861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:46.555297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:46.556024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:46.556482 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:46.556911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:46.685994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:46.694558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4d0f9783-12df-413d-85c0-b5aa51e7bea8 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.152496 Sep 11 10:57:46.695113 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 539/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:46 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:47.716707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:47.717315 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:47.724371 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:47.724853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:47.725289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:47.725976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:47.726429 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:47.726851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:47.856929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:47.865612 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cb1d690b-60f0-462e-8e35-5f7cb026739f tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.152724 Sep 11 10:57:47.866209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 565/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:47 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:48.889221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:48.889881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:48.897083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:48.897565 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:48.898091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:48.898983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:48.899462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:48.899891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:49.040434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:49.048357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-024e1167-8bbe-43dd-817a-c67fb8add68e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.163153 Sep 11 10:57:49.048923 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 540/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:48 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:50.072728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:50.073344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:50.079815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:50.080590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:50.081670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:50.082364 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:50.082809 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:50.083239 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:50.223823 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:50.231550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-578cbd4b-6370-4dca-ba4b-59d2b28b3205 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.162766 Sep 11 10:57:50.232117 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 566/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:50 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:51.255015 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:51.255611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:51.262166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:51.262647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:51.263078 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:51.263793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:51.264248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:51.264667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:51.399370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:51.407764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dacfc549-d33b-48c3-b42a-a3bfe45d95ec tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.156708 Sep 11 10:57:51.408321 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 541/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:51 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:52.102763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3129ff09-bea4-47cf-9957-d5baa397d723", "name": "network-vif-plugged", "status": "completed", "tag": "65134e44-75ce-4fd2-b29f-ef8136f5ab4d"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:52.113548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:52.114159 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:52.114599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:52.125957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] Creating event network-vif-plugged:65134e44-75ce-4fd2-b29f-ef8136f5ab4d for instance 3129ff09-bea4-47cf-9957-d5baa397d723 on hv-cinder-85646 Sep 11 10:57:52.131399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-60e500e2-b4e8-4484-925b-b15c9dacaa3a req-cc22b7a1-a7de-4e88-b97e-3aa41ba2b654 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033018 Sep 11 10:57:52.132099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 567/1108] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:57:52.366597 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:52.367134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:52.372966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:52.373454 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:52.373887 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:52.374611 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:52.375063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:52.375519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:52.400365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fb4c49e4-aa2a-4087-bae8-cccbf02e877d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/ips" status: 200 len: 146 microversion: 2.1 time: 0.177591 Sep 11 10:57:52.400913 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 542/1109] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 10:57:52 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/ips => generated 146 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:52.430737 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:52.431459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:52.438401 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:52.438896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:52.439333 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:52.440666 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:52.441065 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:52.441492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:52.577169 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:52.585154 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-30010e40-7384-4060-aaf0-74890aa4b49c tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.158595 Sep 11 10:57:52.585717 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 568/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:52 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:57:53.608229 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:53.608847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:53.615662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:53.616152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:53.616599 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:53.617299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:53.617759 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:53.618190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:53.748293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:53.756144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-536aba0a-f06a-455c-a42a-fc111a5b8ad9 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.151795 Sep 11 10:57:53.756703 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 543/1111] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:53 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:54.778584 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:54.779198 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:54.788853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:54.788853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:54.788853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:54.788853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:54.789219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:54.789219 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:54.916869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:54.925101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-e60a2f4e-15f2-4049-9fe9-e551f57fcdc6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.150325 Sep 11 10:57:54.925656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 569/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:54 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:55.947695 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:55.948312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:55.954774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:55.955272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:55.955753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:55.957082 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:55.957742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:55.958295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:56.090036 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:56.099166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d4674e45-1cb8-483c-9e78-d3cebfacf564 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.155352 Sep 11 10:57:56.099773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 544/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:55 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:57.121410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:57.121927 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:57.128457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:57.129075 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:57.129515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:57.130204 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:57.130657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:57.131077 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:57.294064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:57.301854 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-505e6bdf-9c93-495e-896d-0cf3d6f8d6c4 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.184365 Sep 11 10:57:57.302417 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 570/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:57 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:57.967555 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ea84d4-92d4-403a-bfa2-122eb36be3e4"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:57:57.970006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:57.976466 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:57.976948 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:57.977380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:57.978067 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:57.978517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:57.978935 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:58.287755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4bf747b2-1d26-4a45-aaa4-65158586a355 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324129 Sep 11 10:57:58.288524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 545/1115] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:57:57 2022] POST /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:57:58.325021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:58.325636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:58.345438 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:58.345929 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:58.346368 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:58.355233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:58.355742 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:58.356191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:58.515391 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:58.523624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1d4f4834-925d-4d89-a477-8c14ea73b979 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1263 microversion: 2.1 time: 0.202972 Sep 11 10:57:58.524171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 571/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:58 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:59.547136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:59.547898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:59.554777 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:59.555258 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:59.555833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:59.556515 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:59.556963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:59.557383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:59.693149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:59.700801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2c479b7b-b995-49af-abc3-7380ee34759e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1450 microversion: 2.1 time: 0.158492 Sep 11 10:57:59.701348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 546/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:59 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:57:59.723576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:57:59.724182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:57:59.730408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:59.730893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:59.731322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:59.732028 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:57:59.732474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:57:59.732891 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:57:59.861933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:57:59.870628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c43c7960-956d-41c6-8535-13a71cf8e995 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1450 microversion: 2.1 time: 0.151660 Sep 11 10:57:59.871191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 572/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:57:59 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:01.745483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3129ff09-bea4-47cf-9957-d5baa397d723", "tag": "65134e44-75ce-4fd2-b29f-ef8136f5ab4d"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:58:01.756224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:01.756700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:01.757123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:01.761007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:01.769512 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] Creating event network-changed:65134e44-75ce-4fd2-b29f-ef8136f5ab4d for instance 3129ff09-bea4-47cf-9957-d5baa397d723 on hv-cinder-85646 Sep 11 10:58:01.774826 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-a6d98024-21bd-48cb-bb40-6fca368e1747 req-dc4b5e09-7ac3-4537-9898-6c5a63fde23b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033475 Sep 11 10:58:01.775438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 547/1119] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:07.950933 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:07.951451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:07.954032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=44 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:07.959213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:07.959718 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:07.960150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:07.960849 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:07.961298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:07.961714 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:08.044507 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lazy-loading 'services' on Instance uuid 0fb42415-5790-4318-a27b-ca33dd9fa30c {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:58:08.116901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a78ae2b4-6b0a-4fdb-bfd9-2c9071909e5d tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c/os-volume_attachments/2ef3a055-a4a2-4ee1-b716-a6927ff48c7e" status: 202 len: 0 microversion: 2.1 time: 0.169646 Sep 11 10:58:08.117492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 573/1120] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:58:07 2022] DELETE /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c/os-volume_attachments/2ef3a055-a4a2-4ee1-b716-a6927ff48c7e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:58:11.147926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:11.150231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:11.152122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=40 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:11.158573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:11.159054 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:11.159514 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:11.160743 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:11.161350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:11.161774 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:11.195931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c5520041-f489-4445-87f3-e693ab4f00ad tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053671 Sep 11 10:58:11.196483 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 548/1121] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:58:11 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:11.209076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:11.209657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:11.215753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:11.216228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:11.216657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:11.217330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:11.217773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:11.218189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:11.247707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-817f7c64-1d84-4990-b786-0d5f7f0ca7ae tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4" status: 200 len: 194 microversion: 2.1 time: 0.044290 Sep 11 10:58:11.248275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 574/1122] 10.222.0.15 () {58 vars in 1413 bytes} [Sun Sep 11 10:58:11 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:12.588740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43af9fa0-71af-4cf1-86a8-a365e7cae4c0"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:58:12.591085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:12.597413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:12.597975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:12.598453 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:12.599149 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:12.599652 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:12.600091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:12.887077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a654c05b-305c-403d-a453-196e7e1f968b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "POST /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302084 Sep 11 10:58:12.890625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 549/1123] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 10:58:12 2022] POST /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:13.493273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:13.493762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:13.500123 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:13.500603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:13.501038 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:13.501723 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:13.502176 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:13.502603 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:13.505250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:13.529119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:58:13.604648 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-45bae385-85c7-4341-836b-f0bb198977be tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 204 len: 0 microversion: 2.1 time: 0.114869 Sep 11 10:58:13.605444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 575/1124] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:58:13 2022] DELETE /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:58:13.616663 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:13.617375 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:13.623818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:13.624313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:13.624752 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:13.625455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:13.625912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:13.626340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:13.759446 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:13.767205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f3c35be1-f974-49b8-8178-8bfb1aee46d6 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1514 microversion: 2.1 time: 0.156173 Sep 11 10:58:13.767819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 550/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:13 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:14.791546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:14.792243 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:14.798541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:14.799024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:14.799474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:14.800162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:14.800610 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:14.801074 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:14.936628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:14.945066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f2d201c6-c41f-439e-bdd3-c065a51d4613 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1514 microversion: 2.1 time: 0.157774 Sep 11 10:58:14.945631 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 576/1126] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:14 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:15.968136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:15.968753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:15.975237 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:15.975759 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:15.976199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:15.976901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:15.977358 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:15.977814 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:16.206227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2f971c8c4d47f59c79495289e59112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80459f77fe204aefb516e8389f1458fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:16.214131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5d65333b-b392-43a1-8f74-897b692981fa tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 200 len: 1514 microversion: 2.1 time: 0.249936 Sep 11 10:58:16.214693 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 551/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:15 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:16.478488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb42415-5790-4318-a27b-ca33dd9fa30c", "name": "network-vif-deleted", "tag": "64525ddf-ed37-46fa-a1c0-dcaca7e2c88c"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:58:16.490838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:16.491307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:16.491763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:16.503049 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] Creating event network-vif-deleted:64525ddf-ed37-46fa-a1c0-dcaca7e2c88c for instance 0fb42415-5790-4318-a27b-ca33dd9fa30c on hv-cinder-85646 Sep 11 10:58:16.509002 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-382d90f2-6237-41c2-8a26-ee6cedb55fec req-85402abf-828e-4a51-ac2a-98b88bbb6d7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034510 Sep 11 10:58:16.510022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 577/1128] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:17.237110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:17.237702 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] [instance: 0fb42415-5790-4318-a27b-ca33dd9fa30c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:17.244434 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:17.244919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:17.245354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:17.246117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:17.246574 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:17.246999 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:17.260732 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] HTTP exception thrown: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Request method failure captured: Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c HTTP/1.1 Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb6n5f3F85quoluYOcp0MvhwrSUIy93V3rQH05gI6t9D4oEIRXlAFgLm1vwkzffzurND9DpOuyp72Q1oIzTCCmU0_e3OXkvH49Pgznvb_Kh9dHvQWB-9fNBoRjbrcGY4CALo0Jdgp19ydIZ7KM5Dr734W8kpXpxk12W4atVQVqZNS6U Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 80459f77fe204aefb516e8389f1458fc Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:58:17.262398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80459f77fe204aefb516e8389f1458fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80459f77fe204aefb516e8389f1458fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80459f77fe204aefb516e8389f1458fc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80459f77fe204aefb516e8389f1458fc"}]}] Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 80459f77fe204aefb516e8389f1458fc Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1728568692 Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesSnapshotTestJSON-1728568692-project Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: fc2f971c8c4d47f59c79495289e59112 Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesSnapshotTestJSON-1728568692-project Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. Sep 11 10:58:17.263975 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '0fb42415-5790-4318-a27b-ca33dd9fa30c'} Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:17.264825 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. Sep 11 10:58:17.266747 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:17.268194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] Returning 404 to user: Instance 0fb42415-5790-4318-a27b-ca33dd9fa30c could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:17.268194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-dd68321d-fc24-4b11-920e-dccb99f29558 tempest-VolumesSnapshotTestJSON-1728568692 tempest-VolumesSnapshotTestJSON-1728568692-project] 10.222.0.15 "GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c" status: 404 len: 111 microversion: 2.1 time: 0.030788 Sep 11 10:58:17.268194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 552/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:17 2022] GET /compute/v2.1/servers/0fb42415-5790-4318-a27b-ca33dd9fa30c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:58:25.742655 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:25.744950 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:25.750992 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.751498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.751930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:25.752614 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.753066 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.753493 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:25.784001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-90c823c5-90d6-4011-8093-b0c6f8fa0196 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048855 Sep 11 10:58:25.784552 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 578/1130] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:58:25 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:25.927443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:25.928014 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:25.934634 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.935123 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.935616 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:25.936342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.936823 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.937250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:25.966103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7f155574-121f-4754-aa46-87dc860d3d56 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4" status: 200 len: 194 microversion: 2.1 time: 0.043566 Sep 11 10:58:25.966667 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 553/1131] 10.222.0.15 () {58 vars in 1413 bytes} [Sun Sep 11 10:58:25 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:25.977653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:25.978137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:25.984030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.984504 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.984935 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:25.985904 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:25.986353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:25.986773 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:26.065872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lazy-loading 'services' on Instance uuid dd20dd85-8203-422c-97ac-d860f7d1d482 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:58:26.136576 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9c54f238-9a30-465d-9de8-cf761d8684e3 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4" status: 202 len: 0 microversion: 2.1 time: 0.163239 Sep 11 10:58:26.137165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 579/1132] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:58:25 2022] DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/11ea84d4-92d4-403a-bfa2-122eb36be3e4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:58:28.317903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:28.318396 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:28.324926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:28.325415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:28.325857 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:28.326554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:28.327044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:28.327534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:28.356228 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b8971d48-6ecd-477b-8365-5c9949a29739 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/43af9fa0-71af-4cf1-86a8-a365e7cae4c0" status: 200 len: 194 microversion: 2.1 time: 0.042383 Sep 11 10:58:28.356788 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 554/1133] 10.222.0.15 () {58 vars in 1413 bytes} [Sun Sep 11 10:58:28 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/43af9fa0-71af-4cf1-86a8-a365e7cae4c0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:28.369375 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:28.369945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:28.376067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:28.376544 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:28.376968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:28.377650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:28.378095 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:28.378515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:28.458593 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lazy-loading 'services' on Instance uuid dd20dd85-8203-422c-97ac-d860f7d1d482 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:58:28.529852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-7ee63602-11fa-46fb-8fff-be6351eaf84a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/43af9fa0-71af-4cf1-86a8-a365e7cae4c0" status: 202 len: 0 microversion: 2.1 time: 0.165643 Sep 11 10:58:28.530430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 580/1134] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 10:58:28 2022] DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments/43af9fa0-71af-4cf1-86a8-a365e7cae4c0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:58:33.950664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:33.952991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:33.959796 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:33.960286 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:33.960726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:33.961419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:33.961878 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:33.962305 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:33.991581 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2054389d-3e80-4639-acbf-3403db4ffaf1 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044844 Sep 11 10:58:33.992120 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 555/1135] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:58:33 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 10:58:34.108547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:34.111121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:34.118130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.118618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.119048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.119763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.120233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.120657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.150041 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-10ce6a3a-d0df-4860-9d66-906d32d64933 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046198 Sep 11 10:58:34.156624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 581/1136] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 10:58:34 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 10:58:34.214956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:34.215459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:34.221328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.221807 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.222241 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.223415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.224428 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.224909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.255322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:58:34.341685 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-31af3c08-2264-42ad-ab6d-7e7d3bc0c286 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 204 len: 0 microversion: 2.1 time: 0.130677 Sep 11 10:58:34.346152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 556/1137] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:58:34 2022] DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 10:58:34.351941 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:34.352541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:34.358279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.358756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.359181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.359889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:34.360601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:34.361013 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:34.523976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:34.532052 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c84c570e-81c0-4ad0-81a3-6ce43989cac8 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1675 microversion: 2.1 time: 0.184865 Sep 11 10:58:34.532623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 582/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:34 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:35.555848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:35.556547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:35.563058 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:35.563526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:35.563966 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:35.564668 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:35.565121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:35.565547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:35.708593 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:35.716566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-20fddad8-e2b2-49eb-8255-05a0eaaabad2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1675 microversion: 2.1 time: 0.165004 Sep 11 10:58:35.717208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 557/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:35 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:36.740051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:36.740668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:36.748209 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:36.748906 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:36.749341 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:36.750043 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:36.750499 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:36.750919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:36.882255 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:36.889902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-81e3312e-0ebe-495b-b0be-b245a2e678de tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1675 microversion: 2.1 time: 0.153715 Sep 11 10:58:36.890456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 583/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:36 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:58:37.890185 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd20dd85-8203-422c-97ac-d860f7d1d482", "name": "network-vif-deleted", "tag": "c040b419-e395-41a7-b4c7-032d5bb7d993"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:58:37.902490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:37.902945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:37.903402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:37.914062 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:37.914760 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:37.928920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:37.929411 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:37.929853 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:37.930561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:37.931016 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:37.931458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:37.959352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] Creating event network-vif-deleted:c040b419-e395-41a7-b4c7-032d5bb7d993 for instance dd20dd85-8203-422c-97ac-d860f7d1d482 on hv-cinder-85646 Sep 11 10:58:37.974431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-7b70e9e2-919c-4360-84ed-6e4c86486dc8 req-545a7ca9-a966-44d4-b0fb-5962aa2f790f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098502 Sep 11 10:58:37.979369 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 558/1141] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:58:38.077413 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0af2b5f354439d92bfa317a0baefd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ecef1ba96491cbfb3e8176e6c22ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:58:38.087191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-71f87ef9-dd21-4fa9-a387-2dea89ee3a4b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 200 len: 1323 microversion: 2.1 time: 0.177355 Sep 11 10:58:38.088388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 584/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:37 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:58:39.112443 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:39.113157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:39.120043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:39.120524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:39.120961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:39.121651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:39.122104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:39.122526 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:39.136937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 HTTP/1.1 Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:58:39.139390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:39.141091 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'dd20dd85-8203-422c-97ac-d860f7d1d482'} Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:39.142032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:39.143460 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:39.144931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:39.144931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a5424cf0-ca17-4d13-9155-0842d06b81fa tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 404 len: 111 microversion: 2.1 time: 0.033540 Sep 11 10:58:39.144931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 559/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:39 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:58:39.150280 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5a966dda-1e96-4528-8301-61b0dedd6da2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '.version_select at 0x7f759bfc0dc0>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:39.154633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a966dda-1e96-4528-8301-61b0dedd6da2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [461bdf92-326f-4682-83bd-523ae79d3f8e] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 10:58:40.161870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a966dda-1e96-4528-8301-61b0dedd6da2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [461bdf92-326f-4682-83bd-523ae79d3f8e] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55502. Sep 11 10:58:40.168008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:40.181758 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5a966dda-1e96-4528-8301-61b0dedd6da2 tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420905176" status: 202 len: 0 microversion: 2.1 time: 1.035191 Sep 11 10:58:40.182329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 585/1144] 10.222.0.15 () {58 vars in 1221 bytes} [Sun Sep 11 10:58:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420905176 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 10:58:43.087543 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:43.088096 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:43.090470 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:43.095853 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:43.096340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:43.096776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:43.097475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:43.098625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:43.099060 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:43.102147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:43.116032 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 HTTP/1.1 Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:58:43.117579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.119388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'dd20dd85-8203-422c-97ac-d860f7d1d482'} Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:43.120355 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.122190 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.124283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:43.124283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-f5cd5fae-9a15-43a2-9ee6-df874bf8041b tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 404 len: 111 microversion: 2.1 time: 0.035430 Sep 11 10:58:43.124283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 560/1145] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:58:43 2022] DELETE /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:58:43.129840 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:43.130579 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: dd20dd85-8203-422c-97ac-d860f7d1d482] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:43.137251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:43.137738 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:43.138177 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:43.138872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:43.139325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:43.139780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:43.155320 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 HTTP/1.1 Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:58:43.157039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.158932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'dd20dd85-8203-422c-97ac-d860f7d1d482'} Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:43.159787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. Sep 11 10:58:43.161567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:43.163046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance dd20dd85-8203-422c-97ac-d860f7d1d482 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:43.163046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b20edeee-32ee-4dd0-b1c3-1becd7c6ac3a tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482" status: 404 len: 111 microversion: 2.1 time: 0.034416 Sep 11 10:58:43.163046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 586/1146] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:43 2022] GET /compute/v2.1/servers/dd20dd85-8203-422c-97ac-d860f7d1d482 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:58:44.304094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:44.304585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:44.321340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:44.321834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:44.322277 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:44.322991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:44.323467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:44.323894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:44.339238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 HTTP/1.1 Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:58:44.340838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.342274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '936f747a-7ced-4807-a2fe-72d35d9b9b20'} Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:44.343043 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.344455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.346524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:44.346524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-87549b67-b28d-4426-8090-0a5dbaa558fe tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 404 len: 111 microversion: 2.1 time: 0.042003 Sep 11 10:58:44.346524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 561/1147] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 10:58:44 2022] DELETE /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:58:44.351692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:58:44.352309 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] [instance: 936f747a-7ced-4807-a2fe-72d35d9b9b20] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:58:44.358830 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:44.359319 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:44.359804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:44.360828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:58:44.361286 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:58:44.362140 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:58:44.366825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:44.378953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] HTTP exception thrown: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Request method failure captured: Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 HTTP/1.1 Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyT7JlihEWk2Huv4A77TNIjCs5PyYA-zZCREzpl82_PVhGgOFGRKVMh_iyG1sY0JjYkjJe497fXZqdmEo4ehYMRKtNi0HaLgm9gTR-bW5CTFp8WR0OS9THOJeMQ1zVNtEaRNCx8HWfabxflhc1YpHY17l31GJ4ZvUL0pkJVA3r6aBE Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:58:44.380956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/204ecef1ba96491cbfb3e8176e6c22ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_204ecef1ba96491cbfb3e8176e6c22ec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/204ecef1ba96491cbfb3e8176e6c22ec"}]}] Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 204ecef1ba96491cbfb3e8176e6c22ec Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1212026029 Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 8d0af2b5f354439d92bfa317a0baefd5 Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeTestJSON-1212026029-project Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.382597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '936f747a-7ced-4807-a2fe-72d35d9b9b20'} Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:58:44.383563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. Sep 11 10:58:44.385144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:58:44.387142 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] Returning 404 to user: Instance 936f747a-7ced-4807-a2fe-72d35d9b9b20 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:58:44.388023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cca3cc31-b64a-48e0-b8ad-adfccd81644d tempest-AttachVolumeTestJSON-1212026029 tempest-AttachVolumeTestJSON-1212026029-project] 10.222.0.15 "GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20" status: 404 len: 111 microversion: 2.1 time: 0.041063 Sep 11 10:58:44.395750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 587/1148] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:58:44 2022] GET /compute/v2.1/servers/936f747a-7ced-4807-a2fe-72d35d9b9b20 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 10:59:03.247006 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:03.249320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:03.251223 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:03.251890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:03.259177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.259681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.260121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.260819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.261267 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.261689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.295983 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-87a68c18-ce66-4ea1-a140-5ceab9b542bc tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053230 Sep 11 10:59:03.296533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 562/1149] 10.222.0.15 () {60 vars in 1343 bytes} [Sun Sep 11 10:59:03 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:59:03.362652 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:03.363166 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:03.366571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:03.373027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.373512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.373881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.374563 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.375008 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.375463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.404131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 10:59:03.475942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9a38bd53-938d-4995-aa6e-6f1d6dcb7889 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 204 len: 0 microversion: 2.20 time: 0.117153 Sep 11 10:59:03.476751 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 588/1150] 10.222.0.15 () {60 vars in 1280 bytes} [Sun Sep 11 10:59:03 2022] DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 10:59:03.485517 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:03.486156 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:03.492117 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.492600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.493042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.493733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:03.494192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:03.494615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:03.623207 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:03.631918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:03.633285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:03.634467 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3354c2b8-d176-416a-9e80-a0dcae91ca62 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.153170 Sep 11 10:59:03.635012 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 563/1151] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:03 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:59:04.660231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:04.661067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:04.668234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:04.668722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:04.669158 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:04.669852 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:04.670304 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:04.670736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:04.803223 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:04.811317 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:04.812757 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:04.813934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-36f29b1b-405b-4f87-b12b-45ef003b2d27 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.158099 Sep 11 10:59:04.814456 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 589/1152] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:04 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:59:05.843623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:05.844336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:05.851559 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:05.852057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:05.852501 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:05.853213 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:05.853673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:05.854100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:06.090513 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:06.098704 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:06.100245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:06.101401 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-70996f2f-5c82-4f17-b13c-d4abe0ea81bb tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1724 microversion: 2.20 time: 0.261793 Sep 11 10:59:06.101964 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 564/1153] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:05 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:59:06.468999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225dc3a6-2ae0-41e9-96e4-be8eaa6f0999", "name": "network-vif-deleted", "tag": "6c108785-bed9-44c2-9247-ce1aa6cc4f1c"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:06.480720 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:06.481205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:06.481628 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:06.494382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] Creating event network-vif-deleted:6c108785-bed9-44c2-9247-ce1aa6cc4f1c for instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 on hv-cinder-85646 Sep 11 10:59:06.500237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-07b190be-8d30-4851-b8e3-8290cfa78d73 req-bf40f9ed-beb9-467f-b0b8-8249bf0b244d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035210 Sep 11 10:59:06.500838 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 590/1154] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:59:07.128754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:07.130089 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:07.137021 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:07.137630 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:07.138192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:07.138982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:07.139685 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:07.140331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:07.188390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:07.189741 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:07.190441 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:07.191705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lazy-loading 'fault' on Instance uuid 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 10:59:07.237789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:07.245819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:07.247042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2238a62cbf1846999b31ea9434b67743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f44d45f87c4b28a1672c48fd9613ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:07.248221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1fea2391-6448-41f1-b5b1-caf66b2975a9 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 200 len: 1372 microversion: 2.20 time: 0.123374 Sep 11 10:59:07.249097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 565/1155] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:07 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 10:59:08.274725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:08.275575 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:08.281980 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:08.282463 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:08.282895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:08.283618 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:08.284067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:08.284487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:08.298458 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 HTTP/1.1 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:59:08.300366 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:08.302722 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '225dc3a6-2ae0-41e9-96e4-be8eaa6f0999'} Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:59:08.303796 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:08.305322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:08.306759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:59:08.306759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b0e599ab-1c5b-4c77-b230-eeb00efe4245 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 404 len: 111 microversion: 2.20 time: 0.031970 Sep 11 10:59:08.306759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 591/1156] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:08 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:59:08.314211 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8265cd35-7a46-4788-b5b6-216f06d28f96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '.version_select at 0x7f75a02530d0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:08.335342 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8265cd35-7a46-4788-b5b6-216f06d28f96 tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552313392" status: 204 len: 0 microversion: 2.20 time: 0.026906 Sep 11 10:59:08.336034 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 566/1157] 10.222.0.15 () {60 vars in 1262 bytes} [Sun Sep 11 10:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552313392 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 10:59:10.106324 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:10.106874 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:10.114137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:10.114616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:10.115048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:10.116644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:10.117099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:10.117526 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:10.130624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 HTTP/1.1 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:59:10.132444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.134221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '225dc3a6-2ae0-41e9-96e4-be8eaa6f0999'} Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:59:10.135132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.136669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.138109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:59:10.138109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9b7c709d-8067-4a1e-a0d7-ec99200b5a4b tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 404 len: 111 microversion: 2.20 time: 0.031468 Sep 11 10:59:10.138109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 592/1158] 10.222.0.15 () {60 vars in 1280 bytes} [Sun Sep 11 10:59:10 2022] DELETE /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:59:10.142920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:10.143564 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:10.150292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:10.150782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:10.151226 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:10.151956 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:10.152418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:10.152849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:10.166177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 HTTP/1.1 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:59:10.167734 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.169402 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '225dc3a6-2ae0-41e9-96e4-be8eaa6f0999'} Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:59:10.170282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. Sep 11 10:59:10.171995 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:10.173290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:59:10.173290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ebba1be3-ccd1-423b-b3cc-186a38dd978d tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999" status: 404 len: 111 microversion: 2.20 time: 0.030720 Sep 11 10:59:10.173290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 567/1159] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:10 2022] GET /compute/v2.1/servers/225dc3a6-2ae0-41e9-96e4-be8eaa6f0999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:59:11.317288 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:11.317781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:11.324846 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:11.325322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:11.325771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:11.326437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:11.326886 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:11.327307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:11.340816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 HTTP/1.1 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 10:59:11.342351 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.343999 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '0b830749-7cd2-44a9-8809-d6ff81ec2da1'} Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:59:11.344909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.346399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.347997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:59:11.347997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-680f2245-3d3a-4fc6-886e-57307845d7da tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 404 len: 111 microversion: 2.20 time: 0.030425 Sep 11 10:59:11.347997 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 593/1160] 10.222.0.15 () {60 vars in 1280 bytes} [Sun Sep 11 10:59:11 2022] DELETE /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:59:11.352558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:11.353170 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] [instance: 0b830749-7cd2-44a9-8809-d6ff81ec2da1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:11.359653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:11.360141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:11.360836 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:11.361536 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:11.361987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:11.362440 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:11.376252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] HTTP exception thrown: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Request method failure captured: Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 HTTP/1.1 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHbyXYGJzmoAR9K7sP4BkFoP9A1zIv9__hHGfff0WAzGI-5VamBeKYsS-_yF-Tvu4h3t-KTjEQByHaM6-6awZFZ2QfCigodFR9-wLg8YecHQnOlIXL9Qz_960G2MEzn-dH08M_YlmR5XYO14E7ROpmLDOyoXcotlY28_Czeec-o_zfP4 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 10:59:11.377771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0f44d45f87c4b28a1672c48fd9613ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0f44d45f87c4b28a1672c48fd9613ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0f44d45f87c4b28a1672c48fd9613ca"}]}] Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: d0f44d45f87c4b28a1672c48fd9613ca Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1906750108 Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: 2238a62cbf1846999b31ea9434b67743 Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1906750108-project Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.379584 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '0b830749-7cd2-44a9-8809-d6ff81ec2da1'} Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 10:59:11.380497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. Sep 11 10:59:11.382604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 10:59:11.383997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] Returning 404 to user: Instance 0b830749-7cd2-44a9-8809-d6ff81ec2da1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 10:59:11.383997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-72588015-ec1c-4451-9c3c-317538579d0e tempest-AttachVolumeShelveTestJSON-1906750108 tempest-AttachVolumeShelveTestJSON-1906750108-project] 10.222.0.15 "GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1" status: 404 len: 111 microversion: 2.20 time: 0.030528 Sep 11 10:59:11.383997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 568/1161] 10.222.0.15 () {60 vars in 1277 bytes} [Sun Sep 11 10:59:11 2022] GET /compute/v2.1/servers/0b830749-7cd2-44a9-8809-d6ff81ec2da1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 10:59:20.637498 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-142df6e2-6be1-4ee7-b1cf-4f181e0c8700 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: .version_select at 0x7f75a016e670>, body: {"keypair": {"name": "tempest-keypair-367252312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg00NBl3HBilroasHaQCdfIcGIN+FVCTztCzBwgVE76NatBrmxV0lNwf2SRtwPPLBvcDTum/6S5w7tDtV5//8H/uYApVnr19w1echcgGbVYSCObKaco83+ZHS2ZsOZpOA=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:20.653551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-142df6e2-6be1-4ee7-b1cf-4f181e0c8700 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:59:20.657621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-142df6e2-6be1-4ee7-b1cf-4f181e0c8700 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:59:20.682624 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-142df6e2-6be1-4ee7-b1cf-4f181e0c8700 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201361 Sep 11 10:59:20.683585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 594/1162] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 10:59:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:59:22.002227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947986498", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c87147a5-b761-4706-bfad-c0c47f4b0a46"}], "security_groups": [{"name": "tempest-securitygroup--1411788098"}], "key_name": "tempest-keypair-367252312", "user_data": "}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:22.029862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:22.030806 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=30 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:22.130390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] validate_networks() for [('c87147a5-b761-4706-bfad-c0c47f4b0a46', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 10:59:22.521439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 10:59:22.521977 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 10:59:22.522598 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 10:59:22.523011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 10:59:22.523477 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 10:59:22.532433 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:22.533019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:22.533644 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:22.534451 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:22.535038 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:22.535586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:22.553438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 10:59:22.557551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 10:59:22.568987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 10:59:22.571294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 10:59:22.622688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1f2acd3c-e9a6-421b-8385-a01ecfc489f3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631375 Sep 11 10:59:22.623567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 569/1163] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 10:59:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 10:59:22.634502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1185b997-86db-42b1-8e83-ad3109448609 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:22.635119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1185b997-86db-42b1-8e83-ad3109448609 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:22.637232 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:22.695801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-1185b997-86db-42b1-8e83-ad3109448609 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:22.702896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1185b997-86db-42b1-8e83-ad3109448609 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1240 microversion: 2.1 time: 0.072129 Sep 11 10:59:22.718561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 595/1164] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:22 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:23.726755 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:23.727350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:23.733798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:23.734283 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:23.734715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:23.735708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:23.736160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:23.736585 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:23.804757 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:23.817304 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-cbc1e56e-17ad-496f-a0e7-3170cf8b17ed tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1244 microversion: 2.1 time: 0.094968 Sep 11 10:59:23.817876 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 570/1165] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:23 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:24.840487 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:24.841094 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:24.847533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:24.848011 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:24.848444 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:24.849129 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:24.850296 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:24.850813 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:24.910525 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:24.918959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-398fcfc6-0eef-47c1-abb8-72ab1530902b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1244 microversion: 2.1 time: 0.082302 Sep 11 10:59:24.919534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 596/1166] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:24 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:59:25.942147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:25.942781 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:25.949438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:25.949932 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:25.950387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:25.951224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:25.951715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:25.952388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:26.022166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:26.030163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-d4e130f4-a28e-4be2-b5c2-6104fd5b38ae tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1292 microversion: 2.1 time: 0.092567 Sep 11 10:59:26.030722 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 571/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:25 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:27.053732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:27.054352 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:27.061076 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:27.061568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:27.062007 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:27.062719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:27.063179 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:27.063645 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:27.142683 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:27.151669 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-634197af-3021-45d4-9faa-9e76232a92da tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1298 microversion: 2.1 time: 0.101906 Sep 11 10:59:27.152247 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 597/1168] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:27 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:28.164962 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208d142f-6f8e-43fc-bfd7-9eff18f2bd2c", "tag": "cb8b778d-e20c-45a6-b981-3375259ef040"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:28.175088 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:28.175682 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:28.176152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:28.176152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:28.176312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:28.183518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:28.183993 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:28.184602 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:28.185304 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:28.185748 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:28.186329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:28.188675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] Creating event network-changed:cb8b778d-e20c-45a6-b981-3375259ef040 for instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c on hv-cinder-85646 Sep 11 10:59:28.194182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-29bc54b6-f5fe-463a-b29e-84ba0131d9b6 req-0048f1cc-dacf-419f-9f97-14d02d7dc23c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033772 Sep 11 10:59:28.195007 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 572/1169] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 10:59:28.313728 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:28.321307 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96fa5586-743e-48dc-9de7-156f44f8247b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.149504 Sep 11 10:59:28.321863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 598/1170] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:28 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:59:29.345573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:29.346252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:29.353626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:29.354109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:29.354575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:29.355261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:29.355783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:29.356205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:29.487944 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:29.495591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-344409b1-d2e5-4200-bc58-7e18359f47fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.154693 Sep 11 10:59:29.496152 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 573/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:29 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:30.518023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:30.518654 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:30.526582 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:30.527068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:30.527533 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:30.528233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:30.528689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:30.529107 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:30.655876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:30.663617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-50dd5793-23b7-48b8-b21a-49a9cf112b71 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.149408 Sep 11 10:59:30.664181 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 599/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:30 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:31.686293 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:31.686866 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:31.693337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:31.693818 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:31.694252 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:31.695578 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:31.696243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:31.696666 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:31.920231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:31.928382 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-5000c293-dae6-4801-bbf0-604a9920e255 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.246049 Sep 11 10:59:31.928984 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 574/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:31 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:32.952308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:32.952907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:32.955151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:32.960475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:32.960955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:32.961380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:32.962308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:32.962756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:32.963175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:33.090937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:33.098763 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a229f0d1-0375-48eb-a4bd-a1ebe6fcbcf4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.150412 Sep 11 10:59:33.099328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 600/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:32 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:34.121760 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:34.122368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:34.124329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:34.125016 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:34.131418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:34.131926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:34.132366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:34.133053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:34.134095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:34.134553 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:34.261313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:34.268904 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7af7a983-28f8-402a-b851-ad3a6415a010 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.151122 Sep 11 10:59:34.269459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 575/1175] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:34 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:35.293030 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:35.293634 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:35.295990 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:35.301311 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:35.301789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:35.302226 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:35.302908 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:35.303365 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:35.303810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:35.434617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:35.442242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-91a984c8-ee93-48cc-8199-e1237b1771fe tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.154411 Sep 11 10:59:35.442808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 601/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:35 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:36.464931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:36.465533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:36.472257 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:36.472733 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:36.473160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:36.473845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:36.474294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:36.474714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:36.601419 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:36.609671 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-efdb328c-653c-481f-8c70-d72769b2aba7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.148963 Sep 11 10:59:36.610234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 576/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:36 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:37.632503 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:37.633042 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:37.640205 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:37.640674 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:37.641102 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:37.641777 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:37.642222 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:37.642635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:37.772215 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:37.780087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f58fba56-5ae7-4f71-8fe8-2e00a9026f6f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.151612 Sep 11 10:59:37.780639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 602/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:37 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:38.802961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:38.803610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:38.810675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:38.811160 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:38.811632 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:38.812323 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:38.812782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:38.813208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:38.941113 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:38.949265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-a7ad1236-3c48-4842-9092-ff2d7f1bf782 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.150166 Sep 11 10:59:38.949820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 577/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:38 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:39.972228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:39.972880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:39.979410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:39.979910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:39.980338 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:39.981019 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:39.981465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:39.981880 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:40.115817 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:40.123450 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b0a331c2-3415-4039-a560-cf06776caff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.155122 Sep 11 10:59:40.124012 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 603/1180] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:39 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:41.147299 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:41.147941 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:41.156153 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:41.156658 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:41.157194 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:41.157919 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:41.158373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:41.158875 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:41.296705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:41.306868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1e262c4b-0daf-4ca8-ba04-1d53578ba401 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.163333 Sep 11 10:59:41.306868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 578/1181] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:41 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:42.328430 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:42.329044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:42.335651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:42.336441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:42.336889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:42.337581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:42.338032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:42.338457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:42.472295 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:42.480898 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-286a66b5-aae9-4ebc-a4a9-a3fe759bc5db tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.156346 Sep 11 10:59:42.481469 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 604/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:42 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:42.637209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208d142f-6f8e-43fc-bfd7-9eff18f2bd2c", "name": "network-vif-plugged", "status": "completed", "tag": "cb8b778d-e20c-45a6-b981-3375259ef040"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:42.646715 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:42.647251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:42.647776 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:42.659884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] Creating event network-vif-plugged:cb8b778d-e20c-45a6-b981-3375259ef040 for instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c on hv-cinder-85646 Sep 11 10:59:42.664872 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-46e46146-26a5-4780-87d7-5f379bff8398 req-0d6d2327-467a-4aa3-89a0-c23e634fd021 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097321 Sep 11 10:59:42.666538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 579/1183] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:59:43.505046 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:43.505653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:43.512910 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:43.513423 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:43.513857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:43.514541 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:43.514991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:43.515410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:43.641819 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:43.649863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3e5d3fa8-3ca7-4ffc-a7d4-a8496f790d87 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.148313 Sep 11 10:59:43.650427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 605/1184] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:43 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:44.673660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:44.674296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:44.680613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:44.681828 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:44.682271 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:44.682961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:44.683418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:44.683867 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:44.817035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:44.824815 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2e25c5cf-8dae-46ee-9648-9ff3203a01a3 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1366 microversion: 2.1 time: 0.156087 Sep 11 10:59:44.825373 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 580/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:44 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 10:59:45.848238 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:45.848907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:45.855399 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:45.855907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:45.856340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:45.857022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:45.857466 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:45.857890 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:46.001716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 10:59:46.009698 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-85600729-9aba-4a47-bf24-6efd92ecd049 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1556 microversion: 2.1 time: 0.165916 Sep 11 10:59:46.010380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 606/1186] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 10:59:45 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 10:59:46.034996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 10:59:46.035524 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 10:59:46.042709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:46.043203 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:46.043677 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:46.044385 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:46.044840 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:46.045270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:46.134820 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-351807ca-2011-4d92-b579-5f4276beab2e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106971 Sep 11 10:59:46.135410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 581/1187] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 10:59:46 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 10:59:47.430132 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208d142f-6f8e-43fc-bfd7-9eff18f2bd2c", "tag": "cb8b778d-e20c-45a6-b981-3375259ef040"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 10:59:47.439923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 10:59:47.440467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 10:59:47.440979 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 10:59:47.452901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] Creating event network-changed:cb8b778d-e20c-45a6-b981-3375259ef040 for instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c on hv-cinder-85646 Sep 11 10:59:47.457963 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-94e290a6-e3e5-4963-865a-576c397ee4d8 req-d678bf48-f29b-468a-95b9-bc7995551574 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155456 Sep 11 10:59:47.458635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 607/1188] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:00:23.275445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:23.276222 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=64 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:23.278536 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=13 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:23.279626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=68 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:23.285836 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3129ff09-bea4-47cf-9957-d5baa397d723", "tag": "65134e44-75ce-4fd2-b29f-ef8136f5ab4d"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:00:23.286986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:23.287521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:23.295575 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:23.296438 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:23.297473 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:23.297627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:23.297746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:23.298053 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:23.298480 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:23.299047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:23.299523 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:23.313134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] Creating event network-changed:65134e44-75ce-4fd2-b29f-ef8136f5ab4d for instance 3129ff09-bea4-47cf-9957-d5baa397d723 on hv-cinder-85646 Sep 11 11:00:23.318080 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-bfe0360b-e825-46cf-817b-1aa5c3eacbdc req-2a4ac8ef-e3b1-431f-8dbb-f54c210449d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041223 Sep 11 11:00:23.319050 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 608/1189] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:00:23.332989 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:00:23.420334 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6d7fb7ed-1917-44fa-8111-1218da708eb6 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 204 len: 0 microversion: 2.1 time: 0.146024 Sep 11 11:00:23.421675 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 582/1190] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:00:23 2022] DELETE /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:00:23.431289 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:23.432150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:23.438524 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:23.439020 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:23.440139 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:23.440866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:23.441329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:23.441759 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:23.579403 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:23.587285 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-62d89606-548a-41b6-a1f1-c3aacc962189 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1574 microversion: 2.1 time: 0.160964 Sep 11 11:00:23.587977 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 609/1191] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:23 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:00:24.612457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:24.613195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:24.620002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:24.620491 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:24.620927 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:24.621623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:24.622080 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:24.622506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:24.816376 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:24.824063 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-298009f7-119d-4aa1-b4a0-7109dddfb18d tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1574 microversion: 2.1 time: 0.216113 Sep 11 11:00:24.824626 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 583/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:24 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:00:25.848745 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:25.849377 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:25.855710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:25.856190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:25.856620 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:25.857306 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:25.857754 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:25.858173 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:26.079079 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:26.087249 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-10ad08b3-9c0a-4130-8563-b64c0408e05b tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1456 microversion: 2.1 time: 0.242381 Sep 11 11:00:26.087907 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 610/1193] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:25 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1456 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:00:26.428116 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3129ff09-bea4-47cf-9957-d5baa397d723", "name": "network-vif-deleted", "tag": "65134e44-75ce-4fd2-b29f-ef8136f5ab4d"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:00:26.438940 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:26.439352 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:26.439817 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:26.450996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] Creating event network-vif-deleted:65134e44-75ce-4fd2-b29f-ef8136f5ab4d for instance 3129ff09-bea4-47cf-9957-d5baa397d723 on hv-cinder-85646 Sep 11 11:00:26.457023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-46eb0405-fe48-4324-88f5-6924eb1c2495 req-34f7a08a-4da7-43c4-a44c-3237d538640f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032430 Sep 11 11:00:26.457620 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 584/1194] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:00:27.111231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:27.112048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:27.118480 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:27.118968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:27.119401 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:27.120125 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:27.120581 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:27.121032 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:27.154325 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:27.154804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:27.155237 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:27.155786 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lazy-loading 'fault' on Instance uuid 3129ff09-bea4-47cf-9957-d5baa397d723 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 11:00:27.196357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:27.203869 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ae7f7a2-552f-4fe7-9c25-08adc28c6613 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 200 len: 1227 microversion: 2.1 time: 0.097331 Sep 11 11:00:27.204427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 611/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:27 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 1227 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:00:28.227001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:28.227717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 3129ff09-bea4-47cf-9957-d5baa397d723] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:28.233928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:28.234449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:28.234888 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:28.235607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:28.236320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:28.236746 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:28.250221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] HTTP exception thrown: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Request method failure captured: Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 HTTP/1.1 Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb1tX7WdDZoKHtONjpv5wgTfI2iJO232ObARBAgKmDPTRSCdk2CQzDRLUzWJn9sfGKCaqv1ArYB8V0OLBa6rKEDUO3TJ_wRIIoEWfwdjV5cs-h3QXzTklbZ8wF0jFZiATU6QeviQ4x1_LXYhOxB4BGD6jppHXz9e-65XqMIR5cI7cLQ Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:00:28.252077 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23556239691f46aa8b39bb6219fc591f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23556239691f46aa8b39bb6219fc591f"}]}] Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: e1b0815853b947bc8f50d91c1ce0ab5a Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. Sep 11 11:00:28.253957 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '3129ff09-bea4-47cf-9957-d5baa397d723'} Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:00:28.254981 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. Sep 11 11:00:28.256700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:28.258325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Returning 404 to user: Instance 3129ff09-bea4-47cf-9957-d5baa397d723 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:00:28.258325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4a54dde0-5fd6-4636-8322-0503e3761f66 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723" status: 404 len: 111 microversion: 2.1 time: 0.031146 Sep 11 11:00:28.258325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 585/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:28 2022] GET /compute/v2.1/servers/3129ff09-bea4-47cf-9957-d5baa397d723 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:00:31.310199 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:31.311256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:31.316001 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968c6bd3-170a-4e7f-9019-5d68db62c717", "tag": "a795b231-68a0-4b6a-a947-b5e2d3d47383"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:00:31.319753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:31.320302 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:31.320793 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:31.321496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:31.321952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:31.322374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:31.326119 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:31.328154 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:31.328595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:31.341477 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] Creating event network-changed:a795b231-68a0-4b6a-a947-b5e2d3d47383 for instance 968c6bd3-170a-4e7f-9019-5d68db62c717 on hv-cinder-85646 Sep 11 11:00:31.346708 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-b57b6c33-704d-48e9-96ac-f74571621c72 req-4332981d-7e40-4b2c-9673-b4630b2d15af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034824 Sep 11 11:00:31.347303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 586/1197] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:00:31.354331 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:00:31.440234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c6749409-9a32-42ad-9c21-560e7810d196 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 204 len: 0 microversion: 2.1 time: 0.132808 Sep 11 11:00:31.444627 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 612/1198] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:00:31 2022] DELETE /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:00:31.449851 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:31.450557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:31.457011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:31.457498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:31.457938 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:31.458643 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:31.459098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:31.459568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:31.604861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:31.613716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b512376e-9d5a-47ce-812c-047904bd9bf0 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1575 microversion: 2.1 time: 0.168139 Sep 11 11:00:31.614282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 587/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:31 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:00:32.638474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:32.639202 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:32.645573 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:32.646057 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:32.646497 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:32.647189 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:32.647670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:32.648096 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:32.902824 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0815853b947bc8f50d91c1ce0ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23556239691f46aa8b39bb6219fc591f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:00:32.911165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c52912a6-bc47-49df-8669-1bfe6e10a21a tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 200 len: 1575 microversion: 2.1 time: 0.276942 Sep 11 11:00:32.911762 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 613/1200] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:32 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:00:33.074106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968c6bd3-170a-4e7f-9019-5d68db62c717", "name": "network-vif-deleted", "tag": "a795b231-68a0-4b6a-a947-b5e2d3d47383"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:00:33.084727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:33.085216 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:33.085649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:33.097238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] Creating event network-vif-deleted:a795b231-68a0-4b6a-a947-b5e2d3d47383 for instance 968c6bd3-170a-4e7f-9019-5d68db62c717 on hv-cinder-85646 Sep 11 11:00:33.102068 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-2f473ffa-7b45-4491-ad75-ce20011163a7 req-3ec6228f-30d0-4164-b9a9-b65098575af9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Sep 11 11:00:33.102706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 588/1201] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:00:33.934336 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:33.935592 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 968c6bd3-170a-4e7f-9019-5d68db62c717] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:33.942322 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:33.942805 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:33.943233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:33.944093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:33.944514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:33.945023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:33.959245 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] HTTP exception thrown: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Request method failure captured: Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 HTTP/1.1 Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb1tX7WdDZoKHtONjpv5wgTfI2iJO232ObARBAgKmDPTRSCdk2CQzDRLUzWJn9sfGKCaqv1ArYB8V0OLBa6rKEDUO3TJ_wRIIoEWfwdjV5cs-h3QXzTklbZ8wF0jFZiATU6QeviQ4x1_LXYhOxB4BGD6jppHXz9e-65XqMIR5cI7cLQ Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:00:33.960975 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23556239691f46aa8b39bb6219fc591f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23556239691f46aa8b39bb6219fc591f"}]}] Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e1b0815853b947bc8f50d91c1ce0ab5a Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. Sep 11 11:00:33.962546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '968c6bd3-170a-4e7f-9019-5d68db62c717'} Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:00:33.963468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. Sep 11 11:00:33.964971 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:33.966290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Returning 404 to user: Instance 968c6bd3-170a-4e7f-9019-5d68db62c717 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:00:33.966290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a762ffa3-1c91-4fad-8749-eed9429b2d9e tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717" status: 404 len: 111 microversion: 2.1 time: 0.031992 Sep 11 11:00:33.966290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 614/1202] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:33 2022] GET /compute/v2.1/servers/968c6bd3-170a-4e7f-9019-5d68db62c717 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:00:34.408573 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:34.409044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:34.415234 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:34.415748 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:34.416204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:34.416886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:34.417337 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:34.417762 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:34.433496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] HTTP exception thrown: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Request method failure captured: Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 HTTP/1.1 Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb1tX7WdDZoKHtONjpv5wgTfI2iJO232ObARBAgKmDPTRSCdk2CQzDRLUzWJn9sfGKCaqv1ArYB8V0OLBa6rKEDUO3TJ_wRIIoEWfwdjV5cs-h3QXzTklbZ8wF0jFZiATU6QeviQ4x1_LXYhOxB4BGD6jppHXz9e-65XqMIR5cI7cLQ Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:00:34.435140 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23556239691f46aa8b39bb6219fc591f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23556239691f46aa8b39bb6219fc591f"}]}] Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: e1b0815853b947bc8f50d91c1ce0ab5a Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.436916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '646d54e0-29b4-45c0-aa4b-4d540825d887'} Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:00:34.437896 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.440437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.442148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Returning 404 to user: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:00:34.442148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8da6e735-36f2-4422-b0e6-e64365b62f60 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 404 len: 111 microversion: 2.1 time: 0.033807 Sep 11 11:00:34.442148 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 589/1203] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:00:34 2022] DELETE /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:00:34.445732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:34.446345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] [instance: 646d54e0-29b4-45c0-aa4b-4d540825d887] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:00:34.452193 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:34.452697 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:34.453093 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:34.453776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:00:34.454380 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:00:34.454892 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:00:34.468175 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] HTTP exception thrown: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Request method failure captured: Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 HTTP/1.1 Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb1tX7WdDZoKHtONjpv5wgTfI2iJO232ObARBAgKmDPTRSCdk2CQzDRLUzWJn9sfGKCaqv1ArYB8V0OLBa6rKEDUO3TJ_wRIIoEWfwdjV5cs-h3QXzTklbZ8wF0jFZiATU6QeviQ4x1_LXYhOxB4BGD6jppHXz9e-65XqMIR5cI7cLQ Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:00:34.469756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23556239691f46aa8b39bb6219fc591f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23556239691f46aa8b39bb6219fc591f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23556239691f46aa8b39bb6219fc591f"}]}] Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: 23556239691f46aa8b39bb6219fc591f Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-TestVolumeBootPattern-962442226 Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: e1b0815853b947bc8f50d91c1ce0ab5a Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-TestVolumeBootPattern-962442226-project Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.471647 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '646d54e0-29b4-45c0-aa4b-4d540825d887'} Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:00:34.472675 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. Sep 11 11:00:34.474265 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:00:34.475725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Returning 404 to user: Instance 646d54e0-29b4-45c0-aa4b-4d540825d887 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:00:34.475725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2cf53156-22d8-43e1-b1cd-2b8630dc1174 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887" status: 404 len: 111 microversion: 2.1 time: 0.029409 Sep 11 11:00:34.475725 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 615/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:00:34 2022] GET /compute/v2.1/servers/646d54e0-29b4-45c0-aa4b-4d540825d887 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:00:35.767189 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b8249626-d45d-4ee3-983d-25e1f8192f19 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] Calling method '.version_select at 0x7f75a02530d0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:00:35.786892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b8249626-d45d-4ee3-983d-25e1f8192f19 tempest-TestVolumeBootPattern-962442226 tempest-TestVolumeBootPattern-962442226-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-13039510" status: 202 len: 0 microversion: 2.1 time: 0.023862 Sep 11 11:00:35.787499 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 590/1205] 10.222.0.15 () {58 vars in 1257 bytes} [Sun Sep 11 11:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-13039510 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:01:16.963156 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:16.963788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:16.965824 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 11:01:16.965967 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sun Sep 11 11:01:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/ips (ip 10.222.0.15) !!! Sep 11 11:01:16.967516 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:16.968165 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:16.976673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:16.977140 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:16.977565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:16.978252 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:16.978696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:16.979109 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:17.005828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ea13f4c-cb71-4383-b21b-ed65041ff3dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/ips" status: 200 len: 150 microversion: 2.1 time: 0.046695 Sep 11 11:01:17.006382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 616/1206] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 11:01:16 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:01:18.370429 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:18.371167 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:18.375240 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be70f98c-d820-4bb2-ba3d-8f84c7228111"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:18.377533 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:18.386225 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:18.386705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:18.387137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:18.387848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:18.388298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:18.388716 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:18.661118 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8f041711-4d69-4239-995d-f4add3011e67 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292059 Sep 11 11:01:18.661898 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 591/1207] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 11:01:18 2022] POST /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:01:26.205515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2ff244e5-ab25-4ca2-9197-0d9552c8c696 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: .version_select at 0x7f759bf128b0>, body: {"keypair": {"name": "tempest-keypair-396141136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu5Q9TMQryiQltCyNIyxr0U/bwfKIDv4c4FCzOdja8lY8P5bMwAwTWc2Y0+EL2AmB1NgYKKTYua0lk/aaqCboxPzyhnjmUpWvhsa2mpW1aqselEQJ+T5IVXCXL0XsZHJg=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:26.221021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-2ff244e5-ab25-4ca2-9197-0d9552c8c696 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:01:26.224991 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-2ff244e5-ab25-4ca2-9197-0d9552c8c696 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:01:26.247185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2ff244e5-ab25-4ca2-9197-0d9552c8c696 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045439 Sep 11 11:01:26.247822 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 617/1208] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 11:01:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:01:27.492468 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1312997339", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c87147a5-b761-4706-bfad-c0c47f4b0a46"}], "security_groups": [{"name": "tempest-securitygroup--2054301620"}], "key_name": "tempest-keypair-396141136", "user_data": "}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:27.594083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] validate_networks() for [('c87147a5-b761-4706-bfad-c0c47f4b0a46', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 11:01:27.956813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 11:01:27.957397 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 11:01:27.958059 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 11:01:27.958472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 11:01:27.958892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 11:01:27.967623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:27.968099 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:27.968537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:27.969255 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:27.969706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:27.970128 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:27.987478 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:01:27.992075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:01:28.002834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 11:01:28.005294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 11:01:28.053227 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-31b10cab-d514-4d6f-9f97-b00b7473ec94 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567199 Sep 11 11:01:28.053868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 592/1209] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 11:01:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 11:01:28.061978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=4 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:28.066945 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6d4679a7-33d0-4790-a91e-f4bf9d985272 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:28.067900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6d4679a7-33d0-4790-a91e-f4bf9d985272 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:28.122917 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6d4679a7-33d0-4790-a91e-f4bf9d985272 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:28.131246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6d4679a7-33d0-4790-a91e-f4bf9d985272 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1241 microversion: 2.1 time: 0.070029 Sep 11 11:01:28.131843 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 618/1210] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:28 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:29.154615 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:29.155243 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:29.164280 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:29.164849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:29.165308 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:29.166010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:29.167031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:29.167487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:29.255097 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:29.264613 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e7bfc62a-29f6-4000-ae1a-d2879717a19e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1301 microversion: 2.1 time: 0.114581 Sep 11 11:01:29.265390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 593/1211] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:29 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:30.293561 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:30.294203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:30.300665 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:30.301149 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:30.301609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:30.302313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:30.302766 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:30.303185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:30.544934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:30.554379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-370ecbda-21a7-4353-aedf-4ead261ce663 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.264834 Sep 11 11:01:30.554958 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 619/1212] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:30 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:30.741430 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a001795-7098-4d71-b8b9-f498d12996a1", "tag": "003941ef-e337-4131-aac6-f872290e98d8"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:30.752495 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:30.753155 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:30.753586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:30.765549 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] Creating event network-changed:003941ef-e337-4131-aac6-f872290e98d8 for instance 7a001795-7098-4d71-b8b9-f498d12996a1 on hv-cinder-85646 Sep 11 11:01:30.770488 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-23f5a258-11a9-4422-a835-ad3581183f77 req-4c3bfe63-80a4-43dd-b4c1-6d3c45cfff74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034118 Sep 11 11:01:30.771095 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 594/1213] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:01:31.577989 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:31.578511 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:31.585467 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:31.585947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:31.586383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:31.587068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:31.587551 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:31.587973 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:31.717278 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:31.724901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-fca2a41f-14d1-452d-99a8-89395a10ff83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.150860 Sep 11 11:01:31.725451 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 620/1214] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:31 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:32.748209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:32.748831 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:32.755059 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:32.755600 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:32.756042 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:32.756729 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:32.757182 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:32.757606 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:32.885221 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:32.892809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0c264e9c-ce30-4b1c-82b5-a0f4536726f8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.149382 Sep 11 11:01:32.893366 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 595/1215] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:32 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:33.920027 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:33.920632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:33.926961 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:33.927449 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:33.927893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:33.928570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:33.929015 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:33.929427 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:34.059413 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:34.067662 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-91ba6989-2732-4b24-98d2-d3fb2072733e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.150984 Sep 11 11:01:34.068578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 621/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:33 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:35.091104 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:35.091848 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:35.098911 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:35.099639 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:35.100084 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:35.100793 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:35.101309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:35.101765 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:35.201346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a001795-7098-4d71-b8b9-f498d12996a1", "name": "network-vif-plugged", "status": "completed", "tag": "003941ef-e337-4131-aac6-f872290e98d8"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:35.212671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:35.213167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:35.213604 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:35.225990 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] Creating event network-vif-plugged:003941ef-e337-4131-aac6-f872290e98d8 for instance 7a001795-7098-4d71-b8b9-f498d12996a1 on hv-cinder-85646 Sep 11 11:01:35.231073 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-e78abb5e-5b5d-4fa4-9881-b845a151af21 req-35efd5e9-c011-4d04-a555-b4943a6ff06a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Sep 11 11:01:35.231866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 622/1217] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 11:01:35.239521 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:35.247404 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-97b7f564-8ad8-4f99-88d4-2b9be39df89e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.160568 Sep 11 11:01:35.248121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 596/1218] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:35 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:36.271231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:36.271957 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:36.278070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:36.278559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:36.278983 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:36.279695 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:36.280147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:36.280571 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:36.414394 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:36.422024 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-96705615-6be8-4c4d-8125-3c4dc1d1b3a2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1367 microversion: 2.1 time: 0.155521 Sep 11 11:01:36.422606 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 623/1219] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:36 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:37.445165 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:37.445780 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:37.452374 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:37.452860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:37.453315 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:37.453991 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:37.454439 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:37.454862 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:37.585072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:01:37.592709 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-54c57ae5-99e0-4e38-9508-76e66776eefa tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1556 microversion: 2.1 time: 0.152277 Sep 11 11:01:37.593268 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 597/1220] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:01:37 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:01:37.615734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:01:37.616228 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:01:37.622459 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:37.622930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:37.623756 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:37.624436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:37.624881 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:37.625300 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:37.855956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-1b74d751-b881-4231-a4ae-c8c8d6c622b6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244938 Sep 11 11:01:37.856543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 624/1221] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 11:01:37 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:01:39.006958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a001795-7098-4d71-b8b9-f498d12996a1", "tag": "003941ef-e337-4131-aac6-f872290e98d8"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:01:39.012052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:39.012845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:01:39.019501 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:01:39.020013 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:01:39.020448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:01:39.031405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] Creating event network-changed:003941ef-e337-4131-aac6-f872290e98d8 for instance 7a001795-7098-4d71-b8b9-f498d12996a1 on hv-cinder-85646 Sep 11 11:01:39.036431 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-d0acce55-4ab4-45f7-9ac9-ae5e35ad5bcc req-407d5279-d31e-44d7-8e43-4bede134853d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033871 Sep 11 11:01:39.037023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 598/1222] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:02:54.288130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:02:54.289696 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:02:54.290283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=30 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:02:54.294876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:54.295356 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:54.303657 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.304131 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.304556 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.305233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.305679 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.306105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.329419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2b2fa793-2e65-4e9c-9eb9-3254892fd262 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/ips" status: 200 len: 149 microversion: 2.1 time: 0.042437 Sep 11 11:02:54.329914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 625/1223] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 11:02:54 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:02:54.339475 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:02:54.340311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:02:54.346841 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be70f98c-d820-4bb2-ba3d-8f84c7228111"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:02:54.349753 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:54.358022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.358496 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.358953 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.359665 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.360145 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.360595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.543303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: POST /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/os-volume_attachments HTTP/1.1 Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 74 Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:02:54.545075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {"volumeAttachment": {"volumeId": "be70f98c-d820-4bb2-ba3d-8f84c7228111"}} Sep 11 11:02:54.546865 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'server_id': '7a001795-7098-4d71-b8b9-f498d12996a1', 'body': {'volumeAttachment': {'volumeId': 'be70f98c-d820-4bb2-ba3d-8f84c7228111'}}} Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:54.547996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:54.549618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 400 to user: Invalid volume: volume be70f98c-d820-4bb2-ba3d-8f84c7228111 is already attached to instances: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-55ece243-75c7-40a6-84a4-b82cda4b71fc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208943 Sep 11 11:02:54.551306 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 599/1224] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 11:02:54 2022] POST /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1/os-volume_attachments => generated 174 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 11:02:54.555231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:54.555761 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:54.561547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.562033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.562470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.563157 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.563637 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.564064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.588599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:02:54.667625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-a3d3447a-30b2-4f6f-9505-d2aa3aeecdd0 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 204 len: 0 microversion: 2.1 time: 0.115857 Sep 11 11:02:54.668185 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 626/1225] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:02:54 2022] DELETE /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:02:54.677348 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:54.677959 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:54.684674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.685147 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.685742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.686442 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:54.686891 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:54.687312 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:54.818707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:02:54.826332 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-65ab5863-4f30-4d6e-87b8-d379c0d698e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1681 microversion: 2.1 time: 0.153371 Sep 11 11:02:54.826887 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 600/1226] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:02:54 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:02:55.851659 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:55.852397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:55.858719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:55.859201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:55.859678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:55.860370 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:55.860828 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:55.861254 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:55.989574 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:02:55.997203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-780173b7-f0be-42c2-b00b-c06303a8b76a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1681 microversion: 2.1 time: 0.150101 Sep 11 11:02:55.997776 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 627/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:02:55 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:02:57.020325 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:57.021768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:57.028357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:57.028849 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:57.029287 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:57.029987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:57.030444 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:57.030869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:57.115971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:02:57.123742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ed539c62-706b-46da-a49b-3818a14c3c43 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 200 len: 1613 microversion: 2.1 time: 0.107212 Sep 11 11:02:57.124242 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 601/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:02:57 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:02:57.425598 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a001795-7098-4d71-b8b9-f498d12996a1", "name": "network-vif-deleted", "tag": "003941ef-e337-4131-aac6-f872290e98d8"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:02:57.440271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:57.441054 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:57.441656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:57.465384 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] Creating event network-vif-deleted:003941ef-e337-4131-aac6-f872290e98d8 for instance 7a001795-7098-4d71-b8b9-f498d12996a1 on hv-cinder-85646 Sep 11 11:02:57.475505 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-dd8a07b9-4047-4e23-9ba1-52a856233b9a req-935f2d69-61a8-4f98-9c7e-fd526f3c7f78 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134452 Sep 11 11:02:57.479345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 628/1229] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:02:58.148539 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:58.149158 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:58.155728 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:58.156214 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:58.156651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:58.157356 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:58.157810 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:58.158236 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:58.172512 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 HTTP/1.1 Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:02:58.173987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:02:58.175736 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '7a001795-7098-4d71-b8b9-f498d12996a1'} Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:02:58.176756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:02:58.178399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:02:58.180024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:02:58.180024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8fc9c6f6-0f7e-491d-8cf4-241a522e26b9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 404 len: 111 microversion: 2.1 time: 0.031609 Sep 11 11:02:58.180024 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 602/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:02:58 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:02:58.185070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bd902d9b-a6be-4bbe-ad37-01d76cc2f5e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '.version_select at 0x7f75a031d550>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:58.204795 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bd902d9b-a6be-4bbe-ad37-01d76cc2f5e6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396141136" status: 202 len: 0 microversion: 2.1 time: 0.023642 Sep 11 11:02:58.205437 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 629/1231] 10.222.0.15 () {58 vars in 1218 bytes} [Sun Sep 11 11:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396141136 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:02:58.875560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:58.876053 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:58.883163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:58.883673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:58.884113 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:58.884809 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:58.885265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:58.885691 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:58.966379 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lazy-loading 'services' on Instance uuid 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 11:02:59.037937 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e49e8063-5930-4b37-92a3-a60efcc31df8 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments/be70f98c-d820-4bb2-ba3d-8f84c7228111" status: 202 len: 0 microversion: 2.1 time: 0.166136 Sep 11 11:02:59.038507 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 603/1232] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 11:02:58 2022] DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments/be70f98c-d820-4bb2-ba3d-8f84c7228111 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:02:59.047431 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:02:59.049981 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:02:59.057901 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:59.058708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:59.059130 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:59.060023 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:02:59.060471 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:02:59.060893 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:02:59.091608 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-9f499c4a-3682-4a84-adf4-4c9f8074d702 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048729 Sep 11 11:02:59.092163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 630/1233] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:02:59 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:03:00.105289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:00.107646 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:00.114680 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.115254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.115727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.116418 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.116873 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.117298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.148936 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c302a46c-bfb5-4b12-9424-c5fec65627f4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047886 Sep 11 11:03:00.149484 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 604/1234] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:03:00 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 11:03:00.212349 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:00.212857 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:00.219155 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.219667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.220101 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.220782 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.221276 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.221644 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.246359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:03:00.321495 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d7538878-f9b9-49e0-ac71-6ca874a72976 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 204 len: 0 microversion: 2.1 time: 0.113342 Sep 11 11:03:00.322115 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 631/1235] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:03:00 2022] DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:03:00.330610 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:00.331218 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:00.338044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.338562 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.338994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.339726 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:00.340176 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:00.340595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:00.472090 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:00.479768 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b7ed6aae-dd81-45a8-bd58-f5ce8b83450e tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1681 microversion: 2.1 time: 0.152992 Sep 11 11:03:00.480335 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 605/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:00 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:01.503990 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:01.504694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:01.511031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:01.511543 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:01.511978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:01.512664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:01.513112 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:01.513532 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:01.642383 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:01.650811 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8877eba2-4732-44b8-82c5-dd23dae3d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1681 microversion: 2.1 time: 0.151145 Sep 11 11:03:01.651378 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 632/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:01 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:02.673363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:02.673982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:02.682486 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:02.682982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:02.683417 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:02.684205 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:02.684661 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:02.687705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:02.782281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:02.790739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-17d8a2a8-ba6f-44cc-8b61-0d805d153644 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 200 len: 1613 microversion: 2.1 time: 0.121569 Sep 11 11:03:02.791295 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 606/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:02 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:02.960673 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208d142f-6f8e-43fc-bfd7-9eff18f2bd2c", "name": "network-vif-deleted", "tag": "cb8b778d-e20c-45a6-b981-3375259ef040"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:02.972519 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:02.973018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:02.973585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:02.985859 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] Creating event network-vif-deleted:cb8b778d-e20c-45a6-b981-3375259ef040 for instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c on hv-cinder-85646 Sep 11 11:03:02.991410 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-78a0a934-1a9b-41ef-97b4-862cc140148c req-6db3bcca-27dd-4154-bf6f-4083452479e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Sep 11 11:03:02.992087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 633/1239] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:03:03.813916 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:03.814530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:03.821471 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:03.822003 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:03.822376 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:03.823143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:03.823653 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:03.824086 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:03.838812 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c HTTP/1.1 Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:03:03.840625 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:03:03.842310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '208d142f-6f8e-43fc-bfd7-9eff18f2bd2c'} Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:03:03.843504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:03:03.845248 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:03:03.847070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:03:03.847070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8488f5bc-57dc-4162-8c13-75a61f91ed53 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 404 len: 111 microversion: 2.1 time: 0.032001 Sep 11 11:03:03.847070 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 607/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:03 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:03:03.854021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4fc2f880-5bec-4f08-9f05-e4ca0d7e3f5d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '.version_select at 0x7f759be37670>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:03.873694 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4fc2f880-5bec-4f08-9f05-e4ca0d7e3f5d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367252312" status: 202 len: 0 microversion: 2.1 time: 0.024648 Sep 11 11:03:03.874279 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 634/1241] 10.222.0.15 () {58 vars in 1218 bytes} [Sun Sep 11 11:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367252312 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:03:04.704193 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2fe9ea45-a252-4225-8f7a-0224f9cca29d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: .version_select at 0x7f75a00a98b0>, body: {"keypair": {"name": "tempest-keypair-1930983778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVOU+UG3dave3M9JGIjmDH5w5VcCUjg6ADrJHFKZ6G+fUYElQt4M7Ks+fKFJ4CC1XUdmod8OdPlKbgL3YZFv6/uIH2YQzpINg1CeipZ5Yvt0YnrWqQDDE81hfUgr0POXQ=="}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:04.719538 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-2fe9ea45-a252-4225-8f7a-0224f9cca29d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:03:04.727901 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-2fe9ea45-a252-4225-8f7a-0224f9cca29d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:03:04.749638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2fe9ea45-a252-4225-8f7a-0224f9cca29d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049361 Sep 11 11:03:04.750238 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 608/1242] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:03:05.927825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1658867418", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c87147a5-b761-4706-bfad-c0c47f4b0a46"}], "security_groups": [{"name": "tempest-securitygroup--1908984128"}], "key_name": "tempest-keypair-1930983778", "user_data": "}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:06.031261 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.network.neutron [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] validate_networks() for [('c87147a5-b761-4706-bfad-c0c47f4b0a46', None, None, None, None, None)] {{(pid=137535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 11:03:06.445814 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 11:03:06.446236 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image limits 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 11:03:06.446701 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 11:03:06.447104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image pref 0:0:0 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 11:03:06.447538 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.virt.hardware [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 11:03:06.456134 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:06.456605 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:06.457029 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:06.457746 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:06.458815 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:06.459234 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:06.475475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:03:06.479316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:03:06.490839 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Going to run 1 instances... {{(pid=137535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 11:03:06.493262 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 11:03:06.539959 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-cf4bd63a-d6db-4565-96e7-5e5659cf4d82 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617776 Sep 11 11:03:06.540597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 635/1243] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 11:03:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 11:03:06.552845 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0c689860-c5ee-46a5-8d66-299513bff699 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:06.553641 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0c689860-c5ee-46a5-8d66-299513bff699 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:06.865019 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-0c689860-c5ee-46a5-8d66-299513bff699 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:06.872701 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0c689860-c5ee-46a5-8d66-299513bff699 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1242 microversion: 2.1 time: 0.324980 Sep 11 11:03:06.873270 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 609/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:06 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1242 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:07.896512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:07.897121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:07.903529 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:07.904018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:07.904457 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:07.905162 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:07.905616 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:07.906044 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:07.980251 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:07.988260 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-8870a53d-bb72-4608-bf53-4bd99eb31f17 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1300 microversion: 2.1 time: 0.096745 Sep 11 11:03:07.988879 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 636/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:07 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:09.011336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:09.012098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:09.018604 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:09.019087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:09.019551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:09.020254 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:09.020712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:09.021137 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:09.174923 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48d8271-8922-47e8-ba12-e180091176c2", "tag": "1ad059c1-66c4-4206-9548-023822636452"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:09.185328 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:09.185824 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:09.186625 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:09.198097 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] Creating event network-changed:1ad059c1-66c4-4206-9548-023822636452 for instance a48d8271-8922-47e8-ba12-e180091176c2 on hv-cinder-85646 Sep 11 11:03:09.203086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-5caa9c5a-3549-4a0f-b43d-0ebf447d53dc req-b12a9e16-1ae4-4d34-b944-769f61cc4a94 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032118 Sep 11 11:03:09.203716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 637/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 11:03:09.258214 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:09.265782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-41a8f14a-a592-48b6-9e0a-0861dc53d980 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.258489 Sep 11 11:03:09.266354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 610/1247] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:09 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:10.290623 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:10.291316 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:10.297441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:10.297913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:10.298344 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:10.299022 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:10.299489 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:10.299911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:10.427187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:10.435224 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-bd119ef9-4057-4511-a12e-22f42509794f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.150005 Sep 11 11:03:10.435810 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 638/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:10 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:11.457764 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:11.458384 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:11.464970 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:11.465455 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:11.465892 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:11.466586 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:11.467039 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:11.467487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:11.598860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:11.606920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-c0ec67f0-4b3d-42cf-86e0-424132c2c0dc tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.153156 Sep 11 11:03:11.618920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 611/1249] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:11 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:12.630192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:12.630797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:12.638000 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:12.638477 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:12.638909 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:12.639617 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:12.640067 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:12.640483 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:12.768448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:12.775905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-582d166f-b08c-426e-aeaa-f2434aa34dc7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.149611 Sep 11 11:03:12.776465 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 639/1250] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:12 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:13.619739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48d8271-8922-47e8-ba12-e180091176c2", "name": "network-vif-plugged", "status": "completed", "tag": "1ad059c1-66c4-4206-9548-023822636452"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:13.629196 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:13.629676 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:13.630107 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:13.641412 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] Creating event network-vif-plugged:1ad059c1-66c4-4206-9548-023822636452 for instance a48d8271-8922-47e8-ba12-e180091176c2 on hv-cinder-85646 Sep 11 11:03:13.646250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-0b02ffb0-4df9-4e79-b557-34f6517e163f req-91b3cc8d-68ef-44fe-9ef8-9fae09aefcd4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Sep 11 11:03:13.646830 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 612/1251] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:03:13.798931 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:13.799558 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:13.807607 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:13.808086 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:13.808515 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:13.809198 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:13.809640 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:13.810055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:13.980568 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:13.990163 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4bb129b6-dd0c-4640-afcc-78a79f8bbe35 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.195801 Sep 11 11:03:13.990719 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 640/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:13 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:15.014705 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:15.015459 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:15.021707 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:15.022706 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:15.023261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:15.024146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:15.024607 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:15.025038 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:15.155690 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:15.163696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4498fac9-c542-48c1-ab9f-61be018f3136 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1368 microversion: 2.1 time: 0.153472 Sep 11 11:03:15.164264 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 613/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:15 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:16.185937 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:16.186468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:16.192932 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:16.193408 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:16.193911 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:16.194789 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:16.195273 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:16.195794 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:16.326203 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:03:16.333770 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-de54fa8f-8a9f-4ded-beca-e1a6c0083b5f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1557 microversion: 2.1 time: 0.151782 Sep 11 11:03:16.334321 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 641/1254] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:03:16 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:03:16.357047 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:03:16.357583 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:03:16.364157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:16.364642 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:16.365081 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:16.365775 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:16.366313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:16.366744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:16.441242 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-333b811d-1c92-415c-80f0-83dc52814c11 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087999 Sep 11 11:03:16.441833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 614/1255] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 11:03:16 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:03:17.348542 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48d8271-8922-47e8-ba12-e180091176c2", "tag": "1ad059c1-66c4-4206-9548-023822636452"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:03:17.353895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:03:17.354567 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:03:17.361213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:03:17.361692 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:03:17.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:03:17.374119 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] Creating event network-changed:1ad059c1-66c4-4206-9548-023822636452 for instance a48d8271-8922-47e8-ba12-e180091176c2 on hv-cinder-85646 Sep 11 11:03:17.379192 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-bd4f1758-e4d7-49ca-9082-999c537b53b1 req-b157f7e2-0d53-445d-ab50-cbd898a15e05 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034316 Sep 11 11:03:17.379842 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 642/1256] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:21.936673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:21.938336 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:21.939018 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:21.999951 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:22.000449 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:22.006400 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:22.006882 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:22.007316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:22.008030 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:22.008485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:22.008909 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:22.033121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-111b96e3-8cf6-4855-a881-637b3515b77a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/ips" status: 200 len: 149 microversion: 2.1 time: 0.097982 Sep 11 11:04:22.033660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 615/1257] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 11:04:21 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:23.363896 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:23.364732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:23.369419 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b9317d-b5b9-48b6-a8d8-0de15fff5271"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:23.371889 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:23.381445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:23.381921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:23.382354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:23.383070 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:23.383547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:23.383968 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:23.657539 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-5e130ac9-9306-4a82-9ce0-5dba4f8bbe75 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295643 Sep 11 11:04:23.658221 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 643/1258] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 11:04:23 2022] POST /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:31.202026 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b9317d-b5b9-48b6-a8d8-0de15fff5271"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:31.204529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:31.210910 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.211395 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.211863 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.212560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.213017 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.213445 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.291380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: POST /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments HTTP/1.1 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 74 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:04:31.293115 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {"volumeAttachment": {"volumeId": "06b9317d-b5b9-48b6-a8d8-0de15fff5271"}} Sep 11 11:04:31.295380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'server_id': 'a48d8271-8922-47e8-ba12-e180091176c2', 'body': {'volumeAttachment': {'volumeId': '06b9317d-b5b9-48b6-a8d8-0de15fff5271'}}} Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:04:31.296544 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:31.298380 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 400 to user: Invalid volume: volume 06b9317d-b5b9-48b6-a8d8-0de15fff5271 is already attached to instances: a48d8271-8922-47e8-ba12-e180091176c2 {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-e3394bbe-4508-4633-a65d-865325fdf36a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097213 Sep 11 11:04:31.300157 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 616/1259] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 11:04:31 2022] POST /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 11:04:31.362586 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:31.363164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:31.369312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.369797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.370231 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.370921 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.371374 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.371825 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.451902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lazy-loading 'services' on Instance uuid a48d8271-8922-47e8-ba12-e180091176c2 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 11:04:31.522145 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ac330a4a-8e5b-48ed-af9b-847f5e95aad6 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments/06b9317d-b5b9-48b6-a8d8-0de15fff5271" status: 202 len: 0 microversion: 2.1 time: 0.164426 Sep 11 11:04:31.522736 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 644/1260] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 11:04:31 2022] DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments/06b9317d-b5b9-48b6-a8d8-0de15fff5271 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:04:31.531557 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:31.533880 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:31.540303 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.540861 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.541456 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.542281 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:31.542756 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:31.543184 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:31.574387 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-52de7077-eae9-468c-a814-28932aa6538b tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Sep 11 11:04:31.574954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 617/1261] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:04:31 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:32.587312 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:32.589643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:32.595947 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.596432 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.596873 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:32.597565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.598018 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.598441 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:32.627518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c8ced3c3-60be-4155-8fa8-259a1386bda5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045099 Sep 11 11:04:32.628069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 645/1262] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:04:32 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 11:04:32.690319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:32.690821 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:32.697263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.697754 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.698199 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:32.698928 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.699389 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.699847 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:32.724884 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Going to try to terminate instance {{(pid=137534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:04:32.801834 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9e30f359-e078-4a9e-adcb-107c8b829947 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 204 len: 0 microversion: 2.1 time: 0.114980 Sep 11 11:04:32.802560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 618/1263] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:04:32 2022] DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 11:04:32.811512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:32.812120 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:32.817939 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.818416 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.818848 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:32.819589 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:32.820045 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:32.820470 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:33.190241 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:33.197797 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-30be3794-62bc-41a1-afbd-1361641488ee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1682 microversion: 2.1 time: 0.390729 Sep 11 11:04:33.198354 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 646/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:32 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1682 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:04:34.221596 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:34.222265 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:34.228588 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:34.229065 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:34.229497 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:34.230180 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:34.230627 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:34.231045 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:34.352141 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 11:04:34.352398 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Sun Sep 11 11:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 (ip 10.222.0.15) !!! Sep 11 11:04:34.359808 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:34.369506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1701d318-1398-47ea-b0f9-83472941944c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1682 microversion: 2.1 time: 0.151915 Sep 11 11:04:34.370064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 619/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:34 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:04:35.394346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:35.395033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:35.402048 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:35.402534 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:35.402976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:35.403708 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:35.404164 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:35.404590 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:35.504925 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:35.512710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-930b20d9-08df-4e36-87c0-cd85d15646a4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 200 len: 1614 microversion: 2.1 time: 0.123282 Sep 11 11:04:35.513512 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 647/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:35 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 1614 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:35.731649 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48d8271-8922-47e8-ba12-e180091176c2", "name": "network-vif-deleted", "tag": "1ad059c1-66c4-4206-9548-023822636452"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:35.742411 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:35.742890 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:35.743319 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:35.755437 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] Creating event network-vif-deleted:1ad059c1-66c4-4206-9548-023822636452 for instance a48d8271-8922-47e8-ba12-e180091176c2 on hv-cinder-85646 Sep 11 11:04:35.761183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-dc7ca00e-9ac7-49cb-b146-e98d01bfeda2 req-289ffb04-f6c8-45d8-968e-ccedad699810 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033075 Sep 11 11:04:35.765832 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 620/1267] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:36.536559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:36.537448 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:36.544395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:36.544912 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:36.545985 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:36.546693 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:36.547144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:36.547650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:36.561390 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 HTTP/1.1 Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:04:36.563056 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:04:36.564732 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'a48d8271-8922-47e8-ba12-e180091176c2'} Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:04:36.565559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:04:36.566955 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:04:36.568256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:04:36.568256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-2a8884e7-2e2d-4a17-9dc8-29c621ca74b5 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 404 len: 111 microversion: 2.1 time: 0.031843 Sep 11 11:04:36.568256 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 648/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:36 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:04:36.573769 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7c37f14f-5ae0-4749-bcd7-69ea88a744d4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '.version_select at 0x7f75a0d5cdc0>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:36.591838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7c37f14f-5ae0-4749-bcd7-69ea88a744d4 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930983778" status: 202 len: 0 microversion: 2.1 time: 0.022096 Sep 11 11:04:36.592963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 621/1269] 10.222.0.15 () {58 vars in 1221 bytes} [Sun Sep 11 11:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930983778 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:04:37.213212 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6173f4e8-929e-4389-92ad-ce513e77bff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: .version_select at 0x7f759bd30550>, body: {"keypair": {"name": "tempest-keypair-588346183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXuj9d37HhuGM40JLWMJfEUUybxSBwQVuhaV92z909jBW6+Zmk06AcVBed2N8girdRByZ5XUEn93/FTJ9yFElJGcptLyc/OndynicQx0R7ZNFunJGb75nsbWUSCebRu6w=="}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:37.233559 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-6173f4e8-929e-4389-92ad-ce513e77bff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:04:37.237496 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.quota [None req-6173f4e8-929e-4389-92ad-ce513e77bff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'key_pairs'} {{(pid=137535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:04:37.259313 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6173f4e8-929e-4389-92ad-ce513e77bff2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049937 Sep 11 11:04:37.259919 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 649/1270] 10.222.0.15 () {60 vars in 1159 bytes} [Sun Sep 11 11:04:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:38.447534 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1542454814", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c87147a5-b761-4706-bfad-c0c47f4b0a46"}], "security_groups": [{"name": "tempest-securitygroup--2142784217"}], "key_name": "tempest-keypair-588346183", "user_data": "}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:38.555773 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] validate_networks() for [('c87147a5-b761-4706-bfad-c0c47f4b0a46', None, None, None, None, None)] {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 11:04:38.962487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 11:04:38.962917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 11:04:38.963391 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 11:04:38.963833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 11:04:38.964250 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 11:04:38.974463 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:38.975011 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:38.975500 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:38.976239 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:38.976689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:38.977311 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:38.996331 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:04:39.001022 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Getting quotas for user f071b2156180461aa0ee9c4c80acdc68 and project ecad09476bb3444da0ca3ef5342bb0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:04:39.011920 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 11:04:39.014357 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 11:04:39.062005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-0c0a4610-fe09-498f-8964-fda3f1592518 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618550 Sep 11 11:04:39.062771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 622/1271] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 11:04:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 11:04:39.074601 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-0ea57440-d2a2-4ca5-93e1-ec0a8129d57a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:39.075206 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-0ea57440-d2a2-4ca5-93e1-ec0a8129d57a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:39.131412 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-0ea57440-d2a2-4ca5-93e1-ec0a8129d57a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:39.138275 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-0ea57440-d2a2-4ca5-93e1-ec0a8129d57a tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1241 microversion: 2.1 time: 0.068513 Sep 11 11:04:39.138833 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 650/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:39 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:40.161638 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:40.162327 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:40.169498 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:40.169982 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:40.171111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:40.171844 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:40.172298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:40.172727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:40.277156 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:40.288313 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-83be1fe7-0f8a-434e-9218-9e80c792e196 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1301 microversion: 2.1 time: 0.130921 Sep 11 11:04:40.289133 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 623/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:40 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1301 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:04:41.312812 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:41.314566 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:41.320940 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:41.321513 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:41.321976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:41.322670 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:41.323118 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:41.323783 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:41.561842 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:41.569668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-24b4784d-298c-44ec-a452-aeb912975c46 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.261208 Sep 11 11:04:41.570345 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 651/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:41 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:41.759688 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ab501-5124-4854-8d8b-6d117a371ea1", "tag": "3ae0a11f-b28e-468c-b48c-202a27dad89d"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:41.772448 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:41.772922 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:41.773363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:41.785100 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] Creating event network-changed:3ae0a11f-b28e-468c-b48c-202a27dad89d for instance 280ab501-5124-4854-8d8b-6d117a371ea1 on hv-cinder-85646 Sep 11 11:04:41.790121 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-cdfd6e78-a2b2-440c-b7da-32ed3a34e39c req-96c1d942-cca9-4c35-a9f2-3f852593a61c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035463 Sep 11 11:04:41.791783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 624/1275] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:42.593406 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:42.594021 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:42.600424 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:42.600905 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:42.601343 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:42.602033 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:42.602488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:42.602952 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:42.730676 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:42.738596 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f1f2b5c5-bdff-487f-a123-8c6a453ee435 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.149813 Sep 11 11:04:42.739153 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 652/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:42 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:43.762044 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:43.762918 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:43.770005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:43.770487 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:43.770925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:43.771652 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:43.772108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:43.772535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:43.910164 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:43.917803 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-fd75bf09-0d31-446b-845e-ac3231b46300 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.160112 Sep 11 11:04:43.918370 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 625/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:43 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:44.940281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:44.940902 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:44.947191 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:44.947684 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:44.948118 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:44.948790 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:44.949235 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:44.949653 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:45.079942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:45.087546 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6ab1bff7-18d1-4fd3-8694-cf12660ac824 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.151468 Sep 11 11:04:45.088105 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 653/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:44 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:46.111363 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:46.111996 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:46.118647 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:46.119134 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:46.119594 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:46.120290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:46.120739 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:46.121159 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:46.254974 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:46.263361 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3bb7e1cc-3310-4cf7-8754-69aa2bcec68f tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.157007 Sep 11 11:04:46.264917 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 626/1279] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:46 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:46.337475 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ab501-5124-4854-8d8b-6d117a371ea1", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0a11f-b28e-468c-b48c-202a27dad89d"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:46.346870 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:46.347335 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:46.347781 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:46.358976 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] Creating event network-vif-plugged:3ae0a11f-b28e-468c-b48c-202a27dad89d for instance 280ab501-5124-4854-8d8b-6d117a371ea1 on hv-cinder-85646 Sep 11 11:04:46.364190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-15443fc4-43b2-4e42-8c7f-4a3d4cc9efae req-69afc8ed-e967-4386-bac4-ed9ac957f17e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104732 Sep 11 11:04:46.364752 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 654/1280] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 11:04:47.286881 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:47.287520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:47.293660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:47.294146 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:47.294612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:47.295869 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:47.296354 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:47.296778 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:47.427900 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:47.435662 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-b35d650d-2c1b-43ba-a15e-cce8b7f68fe9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1367 microversion: 2.1 time: 0.152789 Sep 11 11:04:47.436405 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 627/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:47 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:48.459036 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:48.459664 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:48.465739 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:48.466218 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:48.466651 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:48.467920 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:48.468357 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:48.468780 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:48.596548 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:04:48.604187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-522f8abe-dab5-4bae-a247-6d9e5763a9ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1556 microversion: 2.1 time: 0.149940 Sep 11 11:04:48.604744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 655/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:04:48 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:04:48.627798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:04:48.628329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:04:48.634579 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:48.635064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:48.635569 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:48.636310 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:48.637531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:48.637531 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:48.713819 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-6de51d47-04de-48bb-aa6d-ce8e0c47fdbb tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090535 Sep 11 11:04:48.714425 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 628/1283] 10.222.0.15 () {58 vars in 1275 bytes} [Sun Sep 11 11:04:48 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:04:49.625619 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ab501-5124-4854-8d8b-6d117a371ea1", "tag": "3ae0a11f-b28e-468c-b48c-202a27dad89d"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:04:49.630461 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=6 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:49.636678 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:04:49.637150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:04:49.637570 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:04:49.648808 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] Creating event network-changed:3ae0a11f-b28e-468c-b48c-202a27dad89d for instance 280ab501-5124-4854-8d8b-6d117a371ea1 on hv-cinder-85646 Sep 11 11:04:49.653876 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-d2a18564-b345-4ae1-914b-a61b40618d06 req-834b45fe-8e3f-4ec8-918f-a403e216f23d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032942 Sep 11 11:04:49.654594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 656/1284] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:05:54.232224 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:54.232994 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:54.234340 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:54.235931 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:54.240915 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:05:54.241399 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:05:54.249144 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:05:54.249622 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:05:54.250049 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:05:54.251052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:05:54.251535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:05:54.251965 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:05:54.276950 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-87bf19a9-6ac4-43f5-9acc-74d86d2f4c48 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/ips" status: 200 len: 148 microversion: 2.1 time: 0.045900 Sep 11 11:05:54.277504 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 629/1285] 10.222.0.15 () {58 vars in 1248 bytes} [Sun Sep 11 11:05:54 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:05:55.606914 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:55.607735 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:05:55.613298 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "415f9a7b-7a03-4c22-a723-7a6222baee84"}} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:05:55.615753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:05:55.623549 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:05:55.624031 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:05:55.624464 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:05:55.625147 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:05:55.625594 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:05:55.626071 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:05:55.899395 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f3c17c83-0dd1-4b9a-9925-11fe2068ebee tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "POST /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294171 Sep 11 11:05:55.900099 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 657/1286] 10.222.0.15 () {60 vars in 1323 bytes} [Sun Sep 11 11:05:55 2022] POST /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:06:03.534738 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:03.535298 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:03.541787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:03.542274 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:03.542717 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:03.543415 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:03.543961 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:03.544388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:03.626069 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.objects.instance [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lazy-loading 'services' on Instance uuid 280ab501-5124-4854-8d8b-6d117a371ea1 {{(pid=137534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 11:06:03.696547 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-442ef1d4-ca1b-4dfd-93c7-08090b6c4820 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments/415f9a7b-7a03-4c22-a723-7a6222baee84" status: 202 len: 0 microversion: 2.1 time: 0.165576 Sep 11 11:06:03.697131 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 630/1287] 10.222.0.15 () {58 vars in 1416 bytes} [Sun Sep 11 11:06:03 2022] DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments/415f9a7b-7a03-4c22-a723-7a6222baee84 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:06:03.706445 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:03.708750 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:03.714787 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:03.715271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:03.715744 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:03.716442 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:03.716934 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:03.717454 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:03.750128 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-30a4880d-0f7c-4aaa-8f42-6c32ca3824d1 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048406 Sep 11 11:06:03.750689 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 658/1288] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:06:03 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:06:04.763885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:04.766075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:04.772664 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.773139 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.773570 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:04.774251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.774694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.775111 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:04.805106 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-ac8a59ee-6498-4907-8046-f1cf4eef43ab tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046168 Sep 11 11:06:04.805648 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 631/1289] 10.222.0.15 () {58 vars in 1302 bytes} [Sun Sep 11 11:06:04 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 11:06:04.869771 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:04.870330 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:04.876609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.877633 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.877872 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:04.878540 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.878988 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.879405 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:04.905069 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:06:04.978227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6e817497-fca8-4206-9323-945b2001a71c tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 204 len: 0 microversion: 2.1 time: 0.111808 Sep 11 11:06:04.978930 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 659/1290] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:04 2022] DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:06:04.988177 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:04.988782 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:04.994801 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.995289 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.995789 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:04.996485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:04.996942 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:04.997368 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:05.130567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:05.138302 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-9393b7a0-3d0c-4555-a9bb-57471beb2898 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1680 microversion: 2.1 time: 0.154599 Sep 11 11:06:05.138868 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 632/1291] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:04 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:06.163642 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:06.164242 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:06.170710 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:06.171182 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:06.171656 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:06.172337 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:06.172788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:06.173201 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:06.303609 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:06.311514 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6bb80341-749b-4f27-8147-1e17ecccdea7 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1680 microversion: 2.1 time: 0.152988 Sep 11 11:06:06.312453 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 660/1292] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:06 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:07.334591 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:07.335208 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:07.341744 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:07.342166 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:07.342603 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:07.343297 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:07.343787 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:07.344214 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:07.563350 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f071b2156180461aa0ee9c4c80acdc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecad09476bb3444da0ca3ef5342bb0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:07.571601 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2250ec2e-3183-404b-be9f-82f40819d024 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 200 len: 1680 microversion: 2.1 time: 0.241142 Sep 11 11:06:07.572172 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 633/1293] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:07 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:07.944436 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ab501-5124-4854-8d8b-6d117a371ea1", "name": "network-vif-deleted", "tag": "3ae0a11f-b28e-468c-b48c-202a27dad89d"}]} {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:06:07.957151 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:07.957716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:07.958211 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:07.969895 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.compute.server_external_events [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] Creating event network-vif-deleted:3ae0a11f-b28e-468c-b48c-202a27dad89d for instance 280ab501-5124-4854-8d8b-6d117a371ea1 on hv-cinder-85646 Sep 11 11:06:07.975597 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [req-fc743165-ca48-4804-8f87-270128cc1c16 req-a2b9fc4e-f9e3-4ae9-a84a-eb459696a54a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035518 Sep 11 11:06:07.976388 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 661/1294] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:06:08.595338 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:08.596537 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:08.603285 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:08.603813 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:08.604251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:08.604954 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:08.605408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:08.605835 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:08.620986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 HTTP/1.1 Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:08.622674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:08.624560 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '280ab501-5124-4854-8d8b-6d117a371ea1'} Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:08.626365 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:08.628143 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:08.629694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:08.629694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-573be20b-8590-4c1f-8c0b-11c12bb00a8d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 404 len: 111 microversion: 2.1 time: 0.032678 Sep 11 11:06:08.629694 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 634/1295] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:08 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:08.633705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-4e753551-03d9-4c75-b8f9-17fcaf386ef2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '.version_select at 0x7f75a03ac280>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:08.653913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-4e753551-03d9-4c75-b8f9-17fcaf386ef2 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588346183" status: 202 len: 0 microversion: 2.1 time: 0.024229 Sep 11 11:06:08.655068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 662/1296] 10.222.0.15 () {58 vars in 1218 bytes} [Sun Sep 11 11:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588346183 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 11:06:10.825696 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:10.826245 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:10.833590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:10.834075 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:10.834506 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:10.835192 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:10.835670 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:10.836098 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:10.849902 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 HTTP/1.1 Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:10.851457 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.853309 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '280ab501-5124-4854-8d8b-6d117a371ea1'} Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:10.854329 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.856064 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.858002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:10.858002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-56c8cfeb-f594-41df-9048-779d34f3b30d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 404 len: 111 microversion: 2.1 time: 0.030992 Sep 11 11:06:10.858002 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 635/1297] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:10 2022] DELETE /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:10.861518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:10.862246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 280ab501-5124-4854-8d8b-6d117a371ea1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:10.870688 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:10.871171 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:10.871643 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:10.872398 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:10.872851 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:10.873271 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:10.887477 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 HTTP/1.1 Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:06:10.889187 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.891039 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '280ab501-5124-4854-8d8b-6d117a371ea1'} Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:10.892137 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. Sep 11 11:06:10.893834 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:10.895562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 280ab501-5124-4854-8d8b-6d117a371ea1 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:10.895562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-d864c0ae-551c-4fa8-8b9c-3b1507a63b7d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1" status: 404 len: 111 microversion: 2.1 time: 0.033304 Sep 11 11:06:10.895562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 663/1298] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:10 2022] GET /compute/v2.1/servers/280ab501-5124-4854-8d8b-6d117a371ea1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 11:06:12.031175 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:12.031693 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:12.038217 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.038693 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.039124 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.039833 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.040282 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.040700 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.053987 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 HTTP/1.1 Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:12.055522 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.057057 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': 'a48d8271-8922-47e8-ba12-e180091176c2'} Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:12.057958 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.059595 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.061292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:12.061292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-3910ed90-6c62-4acf-89b1-bc2200d2ce21 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 404 len: 111 microversion: 2.1 time: 0.029523 Sep 11 11:06:12.061292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 636/1299] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:12 2022] DELETE /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:12.065110 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:12.066308 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: a48d8271-8922-47e8-ba12-e180091176c2] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:12.072705 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.073188 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.073621 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.074329 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.074764 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.075190 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.088956 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 HTTP/1.1 Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:06:12.090562 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.092443 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': 'a48d8271-8922-47e8-ba12-e180091176c2'} Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:12.093626 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. Sep 11 11:06:12.095290 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.096804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance a48d8271-8922-47e8-ba12-e180091176c2 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:12.096804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-b4ef6898-1f4a-481e-a384-10ae49a55299 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2" status: 404 len: 111 microversion: 2.1 time: 0.030677 Sep 11 11:06:12.096804 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 664/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:12 2022] GET /compute/v2.1/servers/a48d8271-8922-47e8-ba12-e180091176c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 11:06:12.100472 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:12.100963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:12.106903 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.107378 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.107839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.108519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.108967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.109388 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.122762 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 HTTP/1.1 Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:12.124294 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.126183 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '7a001795-7098-4d71-b8b9-f498d12996a1'} Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:12.127317 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.129571 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.131291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:12.131291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-1cb17643-ebd9-4c24-aafa-a4da0b6233c9 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 404 len: 111 microversion: 2.1 time: 0.029227 Sep 11 11:06:12.131291 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 637/1301] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:12 2022] DELETE /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:12.134578 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:12.135220 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 7a001795-7098-4d71-b8b9-f498d12996a1] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:12.141085 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.141565 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.142004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.142691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:12.143144 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:12.143607 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:12.157521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 HTTP/1.1 Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:06:12.158996 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.161281 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '7a001795-7098-4d71-b8b9-f498d12996a1'} Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:12.162359 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. Sep 11 11:06:12.164174 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:12.165635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 7a001795-7098-4d71-b8b9-f498d12996a1 could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:12.165635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-f0bdbd18-1570-4bc4-be26-78af3d97251d tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1" status: 404 len: 111 microversion: 2.1 time: 0.029685 Sep 11 11:06:12.165635 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 665/1302] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:12 2022] GET /compute/v2.1/servers/7a001795-7098-4d71-b8b9-f498d12996a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:13.300546 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:13.301072 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:13.307535 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:13.308021 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:13.308554 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:13.309261 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:13.309712 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:13.310135 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:13.324085 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c HTTP/1.1 Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:13.325618 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.327328 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '208d142f-6f8e-43fc-bfd7-9eff18f2bd2c'} Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:13.328322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.329971 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.332519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:13.332519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-32426a3c-2310-4f5a-a893-5dcb54714a83 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 404 len: 111 microversion: 2.1 time: 0.030333 Sep 11 11:06:13.332519 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 638/1303] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:13 2022] DELETE /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:13.336004 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:13.336646 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] [instance: 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:13.342978 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:13.343482 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:13.343924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:13.344615 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:13.345068 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:13.345492 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:13.359082 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.wsgi [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] HTTP exception thrown: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Request method failure captured: Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: request: GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c HTTP/1.1 Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept: application/json Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Accept-Encoding: identity Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Connection: close Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Length: 0 Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Content-Type: application/json Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Host: 10.222.0.15 Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Openstack-System-Scope: None Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Auth-Token: gAAAAABjHb-IQnaPJm4izIfRLKC4IDhKt1OwrePeQmZsMg3smXgQep5rE62nzXSIS1i1V3_DiYbmAWZnxGkfb6yfxgwLD2In3NA7OIRepHhi_wn_Ceyt-e2UdR5eyySlGAzIT-x2AB1b-EnNg7oNUNmj4nNr3wITaKCKKFPxpzsPbmLBP7JV_JE Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Id: None Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Domain-Name: None Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Identity-Status: Confirmed Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Is-Admin-Project: True Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Id: default Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Domain-Name: Default Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Role: member,reader Sep 11 11:06:13.360650 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Roles: member,reader Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ecad09476bb3444da0ca3ef5342bb0ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ecad09476bb3444da0ca3ef5342bb0ef", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ecad09476bb3444da0ca3ef5342bb0ef"}]}] Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Id: ecad09476bb3444da0ca3ef5342bb0ef Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792514226 Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Id: default Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Domain-Name: Default Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Id: f071b2156180461aa0ee9c4c80acdc68 Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: X-User-Name: tempest-AttachVolumeNegativeTest-1792514226-project Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: method: > Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: exception: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.362382 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: action_args: {'id': '208d142f-6f8e-43fc-bfd7-9eff18f2bd2c'} Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:13.363942 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. Sep 11 11:06:13.365521 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: ERROR nova.api.openstack.wsgi Sep 11 11:06:13.367152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] Returning 404 to user: Instance 208d142f-6f8e-43fc-bfd7-9eff18f2bd2c could not be found. {{(pid=137535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:13.367152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3fe72d86-9e89-41ac-8bcd-7c18f5c66876 tempest-AttachVolumeNegativeTest-1792514226 tempest-AttachVolumeNegativeTest-1792514226-project] 10.222.0.15 "GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c" status: 404 len: 111 microversion: 2.1 time: 0.030511 Sep 11 11:06:13.367152 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 666/1304] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:13 2022] GET /compute/v2.1/servers/208d142f-6f8e-43fc-bfd7-9eff18f2bd2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 11:06:40.974719 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-718685705", "imageRef": "c8965390-eb4d-49e6-94cd-43e4004281a7", "flavorRef": "452"}} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:06:40.983023 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_api:SELECT=20 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:40.983714 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:41.030427 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.network.neutron [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] validate_networks() for None {{(pid=137534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 11:06:41.301102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Flavor limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 11:06:41.301520 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Image limits 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 11:06:41.301986 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Flavor pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 11:06:41.302390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Image pref 0:0:0 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 11:06:41.302797 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.virt.hardware [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 11:06:41.314005 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:41.314485 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:41.314912 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:41.315660 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:41.316110 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:41.316530 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:41.333393 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Getting quotas for project 2e6c7071912645288d40f666ec2d4582. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 11:06:41.338163 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.quota [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Getting quotas for user efaa6f24a9f941b0a3dd7d16dd46e56f and project 2e6c7071912645288d40f666ec2d4582. Resources: {'ram', 'cores', 'instances'} {{(pid=137534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 11:06:41.349330 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Going to run 1 instances... {{(pid=137534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 11:06:41.352482 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8965390-eb4d-49e6-94cd-43e4004281a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 11:06:41.398837 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-7ff30896-764f-41c7-91a4-8b48c647f7b0 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428628 Sep 11 11:06:41.404390 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 639/1305] 10.222.0.15 () {60 vars in 1147 bytes} [Sun Sep 11 11:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 11:06:41.410990 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-ebb7d1d1-cdc1-4687-8c20-1c9615422f6d tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:41.411706 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-ebb7d1d1-cdc1-4687-8c20-1c9615422f6d tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:41.414816 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 11:06:41.414965 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: Sun Sep 11 11:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 (ip 10.222.0.15) !!! Sep 11 11:06:41.415897 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:41.416807 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:41.675554 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-ebb7d1d1-cdc1-4687-8c20-1c9615422f6d tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:41.682702 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-ebb7d1d1-cdc1-4687-8c20-1c9615422f6d tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1214 microversion: 2.1 time: 0.275680 Sep 11 11:06:41.683474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 667/1306] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:41 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:42.707296 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:42.707967 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:42.714650 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:42.715122 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:42.715619 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:42.716322 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:42.716783 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:42.717209 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:42.793083 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:42.800838 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-2cf35a28-fe0c-4cb8-9b71-0a87be509b71 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1272 microversion: 2.1 time: 0.098021 Sep 11 11:06:42.801410 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 640/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:42 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:43.825283 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:43.826831 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:43.833671 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:43.834434 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:43.834875 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:43.835639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:43.836250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:43.836866 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:43.967949 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8cdf04-8798-404e-bd9e-ade8b6eebfd5", "tag": "360a6726-cb1f-439c-b3fd-3890b83c6262"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:06:43.979055 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:43.979711 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:43.980087 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:43.992681 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] Creating event network-changed:360a6726-cb1f-439c-b3fd-3890b83c6262 for instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 on hv-cinder-85646 Sep 11 11:06:43.997552 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-21a9d86d-e2c8-43eb-b232-48e23a127bd5 req-2e325147-5dee-4a0f-9500-a3fa0cbc3765 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Sep 11 11:06:43.998249 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 641/1308] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 11:06:44.055844 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:44.063827 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-3294138f-766d-4ecf-b429-2915d3fc52a2 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.242524 Sep 11 11:06:44.064397 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 668/1309] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:43 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:45.088566 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:45.089272 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:45.095371 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:45.095885 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:45.096320 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:45.097010 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:45.097462 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:45.097886 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:45.225204 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:45.233551 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-604fb274-ac9d-4342-9276-bdb792dba51e tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.150259 Sep 11 11:06:45.234109 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 642/1310] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:45 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:46.256474 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:46.257845 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:46.263900 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:46.264379 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:46.264858 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:46.265547 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:46.266001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:46.266468 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:46.392953 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:46.401716 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-6c109398-c0fa-4524-87e4-c4abc090b689 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.149274 Sep 11 11:06:46.402294 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 669/1311] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:46 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:47.424344 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:47.425004 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:47.430997 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:47.431511 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:47.431952 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:47.432651 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:47.433103 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:47.433529 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:47.563408 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:47.572727 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-99649dbd-5f34-40c7-b966-091887e655be tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.152265 Sep 11 11:06:47.573292 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 643/1312] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:47 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:48.596167 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:48.596802 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:48.604213 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:48.604691 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:48.605121 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:48.605801 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:48.606246 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:48.606661 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:48.736488 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:48.745775 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-c6e28482-f0b6-44d8-a236-5742937cde5f tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.153430 Sep 11 11:06:48.746332 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 670/1313] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:48 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:48.891742 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8cdf04-8798-404e-bd9e-ade8b6eebfd5", "name": "network-vif-plugged", "status": "completed", "tag": "360a6726-cb1f-439c-b3fd-3890b83c6262"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:06:48.902636 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:48.903108 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:48.903623 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:48.916076 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] Creating event network-vif-plugged:360a6726-cb1f-439c-b3fd-3890b83c6262 for instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 on hv-cinder-85646 Sep 11 11:06:48.921094 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-c283cfa5-5661-4203-a963-9efb0d890e9b req-9dfd145f-8a3c-4c64-8f07-7b80080d0ed7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 Sep 11 11:06:48.921860 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 644/1314] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:06:49.768699 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:49.769340 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:49.775753 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:49.776233 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:49.776668 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:49.777353 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:49.777806 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:49.778227 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:49.906707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:49.914225 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-834bff3b-5556-4b6f-bd27-4d3645bcf84c tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1314 microversion: 2.1 time: 0.149374 Sep 11 11:06:49.914784 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 671/1315] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:49 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:50.938633 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:50.939324 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:50.945558 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:50.946945 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:50.947590 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:50.948290 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:50.948740 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:50.949161 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:51.081035 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:51.088674 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-8061fc18-83e7-43c8-9074-93f709d1cf81 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1464 microversion: 2.1 time: 0.154647 Sep 11 11:06:51.089231 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 645/1316] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:50 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:51.135150 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:51.135707 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:51.142007 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:51.142481 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:51.142915 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:51.143632 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:51.144103 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:51.144523 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:51.168962 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Going to try to terminate instance {{(pid=137535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 11:06:51.244550 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-efcc0878-b984-45bb-a247-8c3941b11006 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 204 len: 0 microversion: 2.1 time: 0.112869 Sep 11 11:06:51.245250 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 672/1317] 10.222.0.15 () {58 vars in 1239 bytes} [Sun Sep 11 11:06:51 2022] DELETE /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 11:06:51.253316 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:51.253926 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:51.259925 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:51.260413 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:51.260854 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:51.261576 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:51.262031 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:51.262458 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:51.324567 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=2 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:51.344136 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG dbcounter [-] [137534] Writing DB stats nova_cell0:SELECT=6 {{(pid=137534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:51.394889 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.policy [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:51.402542 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-4d08aa47-be8a-4221-9609-bebc1b72cbce tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1470 microversion: 2.1 time: 0.153067 Sep 11 11:06:51.403102 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 646/1318] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:51 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 11:06:52.427064 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:52.427686 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:52.429639 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG dbcounter [-] [137535] Writing DB stats nova_cell0:SELECT=2 {{(pid=137535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:06:52.436001 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:52.436479 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:52.436913 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:52.437599 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:52.438051 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:52.438502 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:52.595855 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:52.603863 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-89775282-27ef-4921-9fb2-7f5b6f7bc857 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1470 microversion: 2.1 time: 0.181172 Sep 11 11:06:52.604346 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 673/1319] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:52 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:53.300713 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8cdf04-8798-404e-bd9e-ade8b6eebfd5", "name": "network-vif-deleted", "tag": "360a6726-cb1f-439c-b3fd-3890b83c6262"}]} {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 11:06:53.312052 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:53.313062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:53.313062 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:53.334893 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.compute.server_external_events [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] Creating event network-vif-deleted:360a6726-cb1f-439c-b3fd-3890b83c6262 for instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 on hv-cinder-85646 Sep 11 11:06:53.340673 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [req-5858fbc8-6c1a-4943-9bc1-f28355091585 req-e43181b2-f72a-4d0e-b2de-e430b7d35c01 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043742 Sep 11 11:06:53.341275 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 647/1320] 10.222.0.15 () {64 vars in 1317 bytes} [Sun Sep 11 11:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 11:06:53.627104 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.api.openstack.wsgi [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:53.627734 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.compute.api [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:53.634005 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:53.634484 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:53.634924 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:53.635636 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:53.636087 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:53.636506 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:53.666585 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:53.667055 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:53.667518 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG oslo_concurrency.lockutils [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:53.667962 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.objects.instance [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lazy-loading 'fault' on Instance uuid 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 {{(pid=137535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 11:06:53.707788 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: DEBUG nova.policy [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa6f24a9f941b0a3dd7d16dd46e56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6c7071912645288d40f666ec2d4582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 11:06:53.715667 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: INFO nova.api.openstack.requestlog [None req-256b0068-2f84-47f7-9050-a7635e3fc5df tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 200 len: 1304 microversion: 2.1 time: 0.092334 Sep 11 11:06:53.716232 dv-cinder-856460-3-iscsi devstack@n-api.service[137535]: [pid: 137535|app: 0|req: 674/1321] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:53 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 11:06:54.740195 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Calling method '>' {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 11:06:54.740894 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.compute.api [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] [instance: 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5] Fetching instance by UUID {{(pid=137534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 11:06:54.747771 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:54.748251 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:54.748689 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:54.749383 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Acquiring lock "d589948f-9ff2-4577-8172-465a5e52b5f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 11:06:54.749839 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 11:06:54.750263 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG oslo_concurrency.lockutils [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Lock "d589948f-9ff2-4577-8172-465a5e52b5f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 11:06:54.763963 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.wsgi [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] HTTP exception thrown: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Request method failure captured: Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: request: GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 HTTP/1.1 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept: application/json Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Accept-Encoding: identity Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Connection: close Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Length: 0 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Content-Type: application/json Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Host: 10.222.0.15 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: Openstack-System-Scope: None Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: User-Agent: python-urllib3/1.26.12 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Auth-Token: gAAAAABjHcE_JsXzNKc8BNoaZFRneH4kzawfxeX83mK9IbQhCI0U7Z82wrIR18Gz0SVCwflPsB-5gaW4b43xA8ma5VmeFmgabxAcLVfx1W59uK11ICaGM8RJ5qAnHVSzMv6q9i-VXA_rg8ORSI6DSMmyEBOFIDsdYYyUrC0R6VV2rnD2xfSVdfo Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Id: None Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Domain-Name: None Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Identity-Status: Confirmed Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Is-Admin-Project: True Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Id: default Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Domain-Name: Default Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Id: 2e6c7071912645288d40f666ec2d4582 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Project-Name: tempest-VolumesNegativeTest-1487384451 Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Role: member,reader Sep 11 11:06:54.765612 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Roles: member,reader Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6c7071912645288d40f666ec2d4582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6c7071912645288d40f666ec2d4582"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2e6c7071912645288d40f666ec2d4582", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2e6c7071912645288d40f666ec2d4582"}]}] Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant: tempest-VolumesNegativeTest-1487384451 Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Id: 2e6c7071912645288d40f666ec2d4582 Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-Tenant-Name: tempest-VolumesNegativeTest-1487384451 Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User: tempest-VolumesNegativeTest-1487384451-project Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Id: default Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Domain-Name: Default Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Id: efaa6f24a9f941b0a3dd7d16dd46e56f Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: X-User-Name: tempest-VolumesNegativeTest-1487384451-project Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: method: > Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: exception: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. Sep 11 11:06:54.767568 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: action_args: {'id': '6a8cdf04-8798-404e-bd9e-ade8b6eebfd5'} Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: {{(pid=137534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 11:06:54.768798 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. Sep 11 11:06:54.770490 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: ERROR nova.api.openstack.wsgi Sep 11 11:06:54.772073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: DEBUG nova.api.openstack.wsgi [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] Returning 404 to user: Instance 6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 could not be found. {{(pid=137534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 11:06:54.772073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: INFO nova.api.openstack.requestlog [None req-04b69e14-8edd-4ac5-a4a3-f2bd3b83ff35 tempest-VolumesNegativeTest-1487384451 tempest-VolumesNegativeTest-1487384451-project] 10.222.0.15 "GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5" status: 404 len: 111 microversion: 2.1 time: 0.031869 Sep 11 11:06:54.772073 dv-cinder-856460-3-iscsi devstack@n-api.service[137534]: [pid: 137534|app: 0|req: 648/1322] 10.222.0.15 () {58 vars in 1236 bytes} [Sun Sep 11 11:06:54 2022] GET /compute/v2.1/servers/6a8cdf04-8798-404e-bd9e-ade8b6eebfd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)